Jul 19 12:57:17 devstack cinder-volume[76242]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 19 12:57:17 devstack cinder-volume[76242]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 12:57:17 devstack cinder-volume[76242]: we strongly recommend against using it for new projects. Jul 19 12:57:17 devstack cinder-volume[76242]: If you are already using Eventlet, we recommend migrating to a different Jul 19 12:57:17 devstack cinder-volume[76242]: framework. For more detail see Jul 19 12:57:17 devstack cinder-volume[76242]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 12:57:17 devstack cinder-volume[76242]: import eventlet # noqa Jul 19 12:57:19 devstack cinder-volume[76242]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 12:57:19 devstack cinder-volume[76242]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 12:57:19 devstack cinder-volume[76242]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 12:57:20 devstack cinder-volume[76242]: INFO dbcounter [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Registered counter for database cinder Jul 19 12:57:20 devstack cinder-volume[76242]: DEBUG oslo_db.sqlalchemy.engines [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 12:57:21 devstack cinder-volume[76242]: DEBUG dbcounter [-] [76242] Writer thread running {{(pid=76242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 12:57:21 devstack cinder-volume[76242]: INFO cinder.rpc [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 19 12:57:21 devstack cinder-volume[76242]: INFO cinder.rpc [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 19 12:57:21 devstack cinder-volume[76242]: DEBUG oslo_db.sqlalchemy.engines [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 12:57:21 devstack cinder-volume[76242]: INFO cinder.volume.manager [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Determined volume DB was empty at startup. Jul 19 12:57:21 devstack cinder-volume[76242]: DEBUG cinder.volume.manager [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76242) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 19 12:57:21 devstack cinder-volume[76242]: INFO cinder.volume.manager [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 19 12:57:21 devstack cinder-volume[76242]: WARNING stevedore.named [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 12:57:21 devstack cinder-volume[76242]: WARNING castellan.key_manager [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 12:57:21 devstack cinder-volume[76242]: WARNING cinder.keymgr.conf_key_mgr [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 12:57:21 devstack cinder-volume[76242]: DEBUG cinder.volume.drivers.lvm [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76242) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 19 12:57:21 devstack cinder-volume[76242]: DEBUG oslo_concurrency.processutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:21 devstack cinder-volume[76242]: DEBUG oslo_concurrency.processutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] CMD "cinder-rtstool verify" returned: 0 in 0.438s {{(pid=76242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:21 devstack cinder-volume[76242]: DEBUG oslo_db.sqlalchemy.engines [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 12:57:21 devstack cinder-volume[76242]: INFO cinder.rpc [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 19 12:57:21 devstack cinder-volume[76242]: INFO cinder.rpc [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 19 12:57:21 devstack cinder-volume[76242]: WARNING stevedore.named [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 12:57:21 devstack cinder-volume[76242]: WARNING castellan.key_manager [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 12:57:21 devstack cinder-volume[76242]: INFO cinder.volume.manager [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_db.sqlalchemy.engines [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 12:57:22 devstack cinder-volume[76242]: INFO oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Starting 1 workers Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Started child 76394 {{(pid=76242) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Full set of CONF: {{(pid=76242) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] ******************************************************************************** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Configuration options gathered from: {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] ================================================================================ {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] allow_availability_zone_fallback = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] allow_compression_on_image_upload = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] allowed_direct_url_schemes = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] api_rate_limit = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] auth_strategy = keystone {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] az_cache_duration = 3600 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_availability_zone = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_host = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_stats_polling_interval = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backup_api_class = cinder.backup.api.API {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76394]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backup_name_template = backup-%s {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backup_use_same_host = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backup_use_temp_snapshot = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] chap_password = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] chap_username = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_internal_tenant_project_id = c90f2bc8ca484b279f26d44065aab219 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_internal_tenant_user_id = 0442d812698f4433a7f05b7390826da2 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cloned_volume_same_az = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cluster = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] compression_format = gzip {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] compute_api_class = cinder.compute.nova.API {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] config_dir = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] config_source = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] control_exchange = openstack {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] debug = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] default_availability_zone = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] default_group_type = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] default_volume_type = lvmdriver-1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] disk_geometry = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] driver_client_cert = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] driver_client_cert_key = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] driver_data_namespace = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] driver_ssl_cert_path = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] driver_ssl_cert_verify = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] driver_use_ssl = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] enable_force_upload = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] enable_new_services = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] enable_unsupported_driver = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] enabled_backends = ['lvmdriver-1'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] enforce_multipath_for_image_xfer = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] filter_function = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_api_insecure = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_api_ssl_compression = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_ca_certificates_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_catalog_info = image:glance:publicURL {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_num_retries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance_request_timeout = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] goodness_function = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] graceful_shutdown_timeout = 5 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] group_api_class = cinder.group.api.API {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] host = devstack {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_compress_on_upload = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_conversion_address_space_limit = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_conversion_cpu_limit = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_conversion_disable = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_upload_use_cinder_backend = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_upload_use_internal_tenant = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_volume_cache_enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_volume_cache_max_count = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] image_volume_cache_max_size_gb = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] init_host_max_objects_retrieval = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] instance_format = [instance: %(uuid)s] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] iscsi_target_flags = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] iscsi_write_cache = on {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] iser_helper = tgtadm {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] iser_ip_address = 192.168.122.240 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] iser_port = 3260 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_color = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_config_append = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_dir = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_options = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_rotate_interval = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_rotate_interval_type = days {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] log_rotation_type = none {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] max_age = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] max_logfile_count = 30 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76394]: INFO cinder.volume.manager [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] max_logfile_size_mb = 200 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] max_over_subscription_ratio = 20.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] message_reap_interval = 86400 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] message_ttl = 2592000 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] migration_create_volume_timeout_secs = 300 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] monkey_patch = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] monkey_patch_modules = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] my_ip = 192.168.122.240 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] no_snapshot_gb_quota = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] num_iser_scan_tries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] num_shell_tries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] num_volume_device_scan_tries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] nvmeof_conn_info_version = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] nvmet_ns_id = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] nvmet_port_id = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] osapi_max_limit = 1000 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] osapi_volume_ext_list = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] osapi_volume_listen = 0.0.0.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] osapi_volume_listen_port = 8776 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] osapi_volume_use_ssl = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] osapi_volume_workers = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] per_volume_size_limit = -1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] periodic_fuzzy_delay = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] periodic_interval = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] project_id_regex = [0-9a-f\-]+ {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] public_endpoint = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] publish_errors = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] quota_backup_gigabytes = 1000 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] quota_backups = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] quota_gigabytes = 1000 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] quota_groups = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] quota_snapshots = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] quota_volumes = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] rate_limit_burst = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] rate_limit_except_level = CRITICAL {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] rate_limit_interval = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] reinit_driver_count = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] replication_device = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] report_discard_supported = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] report_interval = 120 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] reservation_clean_interval = 86400 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] reservation_expire = 86400 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] reserved_image_namespaces = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] reserved_percentage = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] rpc_response_timeout = 120 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] run_external_periodic_tasks = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] scst_target_driver = iscsi {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] scst_target_iqn_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_down_time = 720 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] shell_completion = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] snapshot_name_template = snapshot-%s {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] snapshot_same_host = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] split_loggers = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] state_path = /opt/stack/data/cinder {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] storage_availability_zone = nova {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] storage_protocol = iSCSI {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] syslog_log_facility = LOG_USER {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] target_helper = lioadm {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] target_ip_address = 192.168.122.240 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] target_port = 3260 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] target_protocol = iscsi {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] target_secondary_ip_addresses = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] trace_flags = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] transfer_api_class = cinder.transfer.api.API {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] transport_url = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] until_refresh = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] use_chap_auth = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] use_default_quota_class = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] use_journal = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] use_json = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] use_multipath_for_image_xfer = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] use_stderr = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] use_syslog = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] verify_glance_signatures = enabled {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_api_class = cinder.volume.api.API {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_backend_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_clear = zero {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_clear_ionice = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_clear_size = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_copy_bps_limit = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_dd_blocksize = 1M {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_name_template = volume-%s {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_service_inithost_offload = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volume_usage_audit_period = month {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] zoning_mode = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_concurrency.disable_process_locking = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.auth_section = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.auth_type = password {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.auth_version = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.cache = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.delay_auth_decision = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.http_connect_timeout = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.include_service_catalog = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.insecure = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.interface = public {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_password = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcache_username = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.region_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.service_token_roles_required = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.service_type = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.token_cache_time = 300 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.backend = dogpile.cache.null {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.backend_argument = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.backend_expiration_time = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.config_prefix = cache.oslo {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.debug_cache_backend = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.enable_retry_client = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.enable_socket_keepalive = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.expiration_time = 600 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.hashclient_retry_attempts = 2 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.memcache_dead_retry = 300 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.memcache_pool_maxsize = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.memcache_sasl_enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.password = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.proxies = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.redis_db = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.redis_sentinel_service_name = mymaster {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.redis_server = localhost:6379 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.retry_attempts = 2 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.retry_delay = 0.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.socket_keepalive_count = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.socket_keepalive_idle = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.socket_keepalive_interval = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.socket_timeout = 1.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.tls_allowed_ciphers = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.tls_cafile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.tls_certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.tls_enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.tls_keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cache.username = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] coordination.backend_url = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.asyncio_connection = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.asyncio_slave_connection = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.backend = sqlalchemy {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.connection = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.connection_debug = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.connection_parameters = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.connection_recycle_time = 3600 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.connection_trace = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.db_inc_retry_interval = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.db_max_retries = 20 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.db_max_retry_interval = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.db_retry_interval = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.max_overflow = 50 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.max_pool_size = 5 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.max_retries = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.mysql_wsrep_sync_wait = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.pool_timeout = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.retry_interval = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.slave_connection = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.sqlite_synchronous = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.synchronous_reader = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] database.use_db_reconnect = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.connection_string = messaging:// {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.es_doc_type = notification {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.es_scroll_size = 10000 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.es_scroll_time = 2m {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.filter_error_trace = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.hmac_keys = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.sentinel_service_name = mymaster {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.socket_timeout = 0.1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.trace_requests = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler.trace_sqlalchemy = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler_jaeger.process_tags = {} {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler_jaeger.service_name_prefix = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] profiler_otlp.service_name_prefix = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.enforce_new_defaults = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.policy_default_rule = default {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.policy_file = policy.yaml {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_policy.remote_timeout = 60.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] privsep_osbrick.group = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] privsep_osbrick.helper_command = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] privsep_osbrick.user = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack sudo[76399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_sys_admin.group = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_sys_admin.helper_command = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] cinder_sys_admin.user = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.auth_section = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.auth_type = password {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.cafile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.collect_timing = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.insecure = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.send_service_user_token = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.split_loggers = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] service_user.timeout = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.auth_section = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.auth_type = password {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.collect_timing = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.insecure = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.region_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.split_loggers = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] glance.timeout = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.backend_availability_zone = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.chap_password = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.chap_username = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.disk_geometry = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.driver_client_cert = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.driver_client_cert_key = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.driver_data_namespace = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.driver_use_ssl = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.enable_unsupported_driver = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.extra_capabilities = {} {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.filter_function = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.goodness_function = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.iscsi_target_flags = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.iscsi_write_cache = on {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.iser_helper = tgtadm {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.iser_port = 3260 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.lvm_mirrors = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.lvm_share_target = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.lvm_type = auto {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.num_shell_tries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.nvmet_port_id = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.replication_device = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.report_discard_supported = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.reserved_percentage = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.scst_target_driver = iscsi {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.scst_target_iqn_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.storage_protocol = iSCSI {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.target_helper = tgtadm {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.target_port = 3260 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.target_protocol = iscsi {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.trace_flags = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.unique_fqdn_network = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.use_chap_auth = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_backend_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_clear = zero {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_clear_ionice = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_clear_size = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volume_group = cinder-volumes {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_reports.file_event_handler = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_reports.log_dir = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.backend_availability_zone = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.backend_host = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.chap_password = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.chap_username = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.chiscsi_conf = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.disk_geometry = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.driver_client_cert = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.driver_data_namespace = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.driver_use_ssl = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.extra_capabilities = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.filter_function = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.goodness_function = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.iser_helper = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.iser_ip_address = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.iser_port = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.iser_target_prefix = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.lvm_conf_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.lvm_mirrors = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.lvm_share_target = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.lvm_type = auto {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.num_shell_tries = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.nvmet_port_id = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.replication_device = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.report_discard_supported = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.reserved_percentage = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.scst_target_driver = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.storage_protocol = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.target_helper = lioadm {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.target_ip_address = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.target_port = 3260 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.target_protocol = iscsi {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.trace_flags = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.use_chap_auth = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_clear = zero {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_clear_size = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] lvmdriver-1.volumes_dir = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.ssl = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.ssl_version = {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_notifications.driver = [] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_notifications.retry = -1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] oslo_messaging_notifications.transport_url = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] key_manager.fixed_key = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.barbican_api_version = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.barbican_endpoint = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.barbican_endpoint_type = public {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.barbican_region_name = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.cafile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.collect_timing = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.insecure = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.number_of_retries = 60 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.retry_delay = 1 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.send_service_user_token = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.split_loggers = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.timeout = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.verify_ssl = True {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican.verify_ssl_path = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.auth_section = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.auth_type = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.cafile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.certfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.collect_timing = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.insecure = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.keyfile = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.split_loggers = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] barbican_service_user.timeout = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.approle_role_id = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.approle_secret_id = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.auth_method = approle {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.auth_path = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.kv_mountpoint = secret {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.kv_path = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.kv_version = 2 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.namespace = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.root_token_id = **** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.ssl_ca_crt_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.timeout = 60.0 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.token_file = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.token_role = None {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.use_ssl = False {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 12:57:22 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] ******************************************************************************** {{(pid=76242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 19 12:57:22 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:22 devstack sudo[76478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:22 devstack sudo[76478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:22 devstack sudo[76478]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.304s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 12:57:22 devstack cinder-volume[76394]: INFO cinder.brick.local_dev.lvm [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:22 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:22 devstack sudo[76585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:57:23 devstack sudo[76585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:23 devstack sudo[76585]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:23 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:23 devstack cinder-volume[76394]: DEBUG cinder.brick.local_dev.lvm [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76394) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 19 12:57:23 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:23 devstack sudo[76664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:23 devstack sudo[76664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:23 devstack sudo[76664]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:23 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:23 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:23 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:23 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:23 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:23 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:24 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:24 devstack sudo[76938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 19 12:57:24 devstack sudo[76938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:24 devstack sudo[76938]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.288s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:24 devstack sudo[77011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:57:24 devstack sudo[77011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:24 devstack sudo[77011]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:24 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:57:24 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:24 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:24 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:25 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:57:25 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:25 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:25 devstack sudo[77107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:25 devstack sudo[77107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:25 devstack sudo[77107]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:25 devstack sudo[77191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:25 devstack sudo[77191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:25 devstack sudo[77191]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:25 devstack cinder-volume[76394]: INFO cinder.volume.drivers.lvm [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:25 devstack sudo[77195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:25 devstack sudo[77195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:26 devstack sudo[77195]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG cinder.volume.drivers.lvm [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Updating volume stats {{(pid=76394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:26 devstack sudo[77198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:57:26 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:26 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:26 devstack sudo[77201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:57:26 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:26 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:26 devstack sudo[77210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:26 devstack sudo[77210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:26 devstack sudo[77210]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:26 devstack sudo[77213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:57:26 devstack sudo[77213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:27 devstack sudo[77213]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:27 devstack cinder-volume[76394]: INFO cinder.volume.driver [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Driver hasn't implemented _init_vendor_properties() Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG cinder.volume.driver [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76394) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG oslo_db.sqlalchemy.engines [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76394) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG dbcounter [-] [76394] Writer thread running {{(pid=76394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG cinder.db.api [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Building query based on filter {{(pid=76394) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG cinder.image.image_utils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76394) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 19 12:57:27 devstack cinder-volume[76394]: INFO cinder.keymgr.migration [None req-7bcf5804-f1d7-4302-93c4-25a1e3d0b38a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG cinder.volume.drivers.lvm [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Updating volume stats {{(pid=76394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:27 devstack sudo[77222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:57:27 devstack sudo[77222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:27 devstack sudo[77222]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:27 devstack sudo[77227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:57:27 devstack sudo[77227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:27 devstack sudo[77227]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:27 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:27 devstack sudo[77230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:27 devstack sudo[77230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:28 devstack sudo[77230]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:28 devstack sudo[77234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:57:28 devstack sudo[77234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:28 devstack sudo[77234]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG cinder.manager [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Notifying Schedulers of capabilities ... {{(pid=76394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 12:57:28 devstack cinder-volume[76394]: INFO cinder.volume.manager [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Driver initialization completed successfully. Jul 19 12:57:28 devstack cinder-volume[76394]: INFO cinder.manager [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Initiating service 2 cleanup Jul 19 12:57:28 devstack cinder-volume[76394]: INFO cinder.manager [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Service 2 cleanup completed. Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG cinder.service [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Creating RPC server for service cinder-volume {{(pid=76394) start /opt/stack/cinder/cinder/service.py:231}} Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG cinder.service [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76394) start /opt/stack/cinder/cinder/service.py:237}} Jul 19 12:57:28 devstack cinder-volume[76394]: INFO cinder.volume.manager [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG cinder.volume.drivers.lvm [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Updating volume stats {{(pid=76394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:28 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:57:28 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:28 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:28 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:28 devstack sudo[77242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:57:28 devstack sudo[77242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:29 devstack sudo[77242]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:29 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:29 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:29 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:57:29 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:29 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:29 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:29 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:57:29 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:57:29 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:57:29 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Jul 19 12:57:29 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:57:29 devstack cinder-volume[76394]: INFO cinder.volume.manager [None req-0a88d941-7c70-4c6a-818a-584c125d9f2c None None] Driver post RPC initialization completed successfully. Jul 19 12:57:32 devstack cinder-volume[76242]: DEBUG dbcounter [-] [76242] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 12:57:39 devstack cinder-volume[76394]: DEBUG dbcounter [-] [76394] Writing DB stats cinder:SELECT=3 {{(pid=76394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 12:57:39 devstack cinder-volume[76394]: DEBUG dbcounter [-] [76394] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 12:58:25 devstack cinder-volume[76394]: DEBUG oslo_service.periodic_task [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 12:58:25 devstack cinder-volume[76394]: DEBUG cinder.volume.drivers.lvm [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Updating volume stats {{(pid=76394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 12:58:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:58:25 devstack sudo[79219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:58:25 devstack sudo[79219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:58:25 devstack sudo[79219]: pam_unix(sudo:session): session closed for user root Jul 19 12:58:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:58:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:58:25 devstack sudo[79222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:58:25 devstack sudo[79222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:58:26 devstack sudo[79222]: pam_unix(sudo:session): session closed for user root Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:58:26 devstack sudo[79225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:58:26 devstack sudo[79225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:58:26 devstack sudo[79225]: pam_unix(sudo:session): session closed for user root Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:58:26 devstack sudo[79228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:58:26 devstack sudo[79228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:58:26 devstack sudo[79228]: pam_unix(sudo:session): session closed for user root Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG cinder.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Notifying Schedulers of capabilities ... {{(pid=76394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG oslo_service.periodic_task [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running periodic task VolumeManager._thread_info {{(pid=76394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG cinder.volume.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] thread count: 6 {{(pid=76394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 12:58:26 devstack cinder-volume[76394]: DEBUG cinder.volume.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] thread info: [<_MainThread(MainThread, started 134674818474112)>, , , , , ] {{(pid=76394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 12:59:25 devstack cinder-volume[76394]: DEBUG oslo_service.periodic_task [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 12:59:25 devstack cinder-volume[76394]: DEBUG cinder.volume.drivers.lvm [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Updating volume stats {{(pid=76394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 12:59:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:59:25 devstack sudo[82523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 12:59:25 devstack sudo[82523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:59:25 devstack sudo[82523]: pam_unix(sudo:session): session closed for user root Jul 19 12:59:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:59:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:59:25 devstack sudo[82527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:59:25 devstack sudo[82527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:59:26 devstack sudo[82527]: pam_unix(sudo:session): session closed for user root Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:59:26 devstack sudo[82530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 12:59:26 devstack sudo[82530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:59:26 devstack sudo[82530]: pam_unix(sudo:session): session closed for user root Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 12:59:26 devstack sudo[82534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 12:59:26 devstack sudo[82534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 12:59:26 devstack sudo[82534]: pam_unix(sudo:session): session closed for user root Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG cinder.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Notifying Schedulers of capabilities ... {{(pid=76394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG oslo_service.periodic_task [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running periodic task VolumeManager._thread_info {{(pid=76394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG cinder.volume.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] thread count: 6 {{(pid=76394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 12:59:26 devstack cinder-volume[76394]: DEBUG cinder.volume.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] thread info: [<_MainThread(MainThread, started 134674818474112)>, , , , , ] {{(pid=76394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 12:59:39 devstack cinder-volume[76394]: DEBUG dbcounter [-] [76394] Writing DB stats cinder:SELECT=1 {{(pid=76394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 12:59:39 devstack cinder-volume[76394]: DEBUG dbcounter [-] [76394] Writing DB stats cinder:UPDATE=1 {{(pid=76394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:00:25 devstack cinder-volume[76394]: DEBUG oslo_service.periodic_task [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:00:25 devstack cinder-volume[76394]: DEBUG cinder.volume.drivers.lvm [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Updating volume stats {{(pid=76394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 13:00:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:00:25 devstack sudo[84446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 13:00:25 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:00:25 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root Jul 19 13:00:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:00:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:00:25 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 13:00:25 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:00:26 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:00:26 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 13:00:26 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:00:26 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:00:26 devstack sudo[84482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 13:00:26 devstack sudo[84482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:00:26 devstack sudo[84482]: pam_unix(sudo:session): session closed for user root Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG cinder.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Notifying Schedulers of capabilities ... {{(pid=76394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG oslo_service.periodic_task [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running periodic task VolumeManager._thread_info {{(pid=76394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG cinder.volume.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] thread count: 6 {{(pid=76394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:00:26 devstack cinder-volume[76394]: DEBUG cinder.volume.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] thread info: [<_MainThread(MainThread, started 134674818474112)>, , , , , ] {{(pid=76394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:01:25 devstack cinder-volume[76394]: DEBUG oslo_service.periodic_task [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:01:25 devstack cinder-volume[76394]: DEBUG cinder.volume.drivers.lvm [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Updating volume stats {{(pid=76394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 13:01:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:25 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 13:01:25 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:25 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:25 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:26 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 13:01:26 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:26 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:26 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 13:01:26 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:26 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:26 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 13:01:26 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:26 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:26 devstack cinder-volume[76394]: DEBUG oslo_concurrency.processutils [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:26 devstack cinder-volume[76394]: DEBUG cinder.manager [None req-31aa925b-c4c5-4704-96d1-129276e12903 None None] Notifying Schedulers of capabilities ... {{(pid=76394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:01:39 devstack cinder-volume[76394]: DEBUG dbcounter [-] [76394] Writing DB stats cinder:SELECT=1 {{(pid=76394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:01:39 devstack cinder-volume[76394]: DEBUG dbcounter [-] [76394] Writing DB stats cinder:UPDATE=1 {{(pid=76394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:01:53 devstack cinder-volume[76242]: INFO oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Caught SIGTERM, stopping children Jul 19 13:01:53 devstack cinder-volume[76242]: DEBUG oslo_concurrency.lockutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Acquiring lock "singleton_lock" {{(pid=76242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 13:01:53 devstack cinder-volume[76242]: DEBUG oslo_concurrency.lockutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Acquired lock "singleton_lock" {{(pid=76242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 13:01:53 devstack cinder-volume[76242]: DEBUG oslo_concurrency.lockutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Releasing lock "singleton_lock" {{(pid=76242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 13:01:53 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Stop services. {{(pid=76242) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 19 13:01:53 devstack cinder-volume[76242]: DEBUG oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Killing children. {{(pid=76242) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 19 13:01:53 devstack cinder-volume[76242]: INFO oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Waiting on 1 children to exit Jul 19 13:01:53 devstack cinder-volume[76394]: DEBUG oslo_concurrency.lockutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Acquiring lock "singleton_lock" {{(pid=76394) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 13:01:53 devstack cinder-volume[76394]: DEBUG oslo_concurrency.lockutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Acquired lock "singleton_lock" {{(pid=76394) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 13:01:53 devstack cinder-volume[76394]: DEBUG oslo_concurrency.lockutils [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Releasing lock "singleton_lock" {{(pid=76394) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 13:01:53 devstack cinder-volume[76394]: WARNING amqp [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 13:01:53 devstack cinder-volume[76394]: WARNING amqp [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 13:01:53 devstack cinder-volume[76242]: INFO oslo_service.backend._eventlet.service [None req-b370aaae-d6db-402d-b29a-a3412315940c None None] Child 76394 exited with status 0 Jul 19 13:01:53 devstack cinder-volume[86474]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 19 13:01:53 devstack cinder-volume[86474]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 13:01:53 devstack cinder-volume[86474]: we strongly recommend against using it for new projects. Jul 19 13:01:53 devstack cinder-volume[86474]: If you are already using Eventlet, we recommend migrating to a different Jul 19 13:01:53 devstack cinder-volume[86474]: framework. For more detail see Jul 19 13:01:53 devstack cinder-volume[86474]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 13:01:53 devstack cinder-volume[86474]: import eventlet # noqa Jul 19 13:01:55 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 13:01:55 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 13:01:55 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 13:01:56 devstack cinder-volume[86474]: INFO dbcounter [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Registered counter for database cinder Jul 19 13:01:56 devstack cinder-volume[86474]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG dbcounter [-] [86474] Writer thread running {{(pid=86474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 13:01:57 devstack cinder-volume[86474]: INFO cinder.rpc [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 19 13:01:57 devstack cinder-volume[86474]: INFO cinder.rpc [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:01:57 devstack cinder-volume[86474]: INFO cinder.volume.manager [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Determined volume DB was empty at startup. Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG cinder.volume.manager [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86474) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 19 13:01:57 devstack cinder-volume[86474]: INFO cinder.volume.manager [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 19 13:01:57 devstack cinder-volume[86474]: WARNING stevedore.named [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 13:01:57 devstack cinder-volume[86474]: WARNING castellan.key_manager [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 13:01:57 devstack cinder-volume[86474]: WARNING cinder.keymgr.conf_key_mgr [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 13:01:57 devstack cinder-volume[86474]: INFO cinder.volume.manager [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:01:57 devstack cinder-volume[86474]: INFO oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Starting 1 workers Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Started child 86690 {{(pid=86474) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Full set of CONF: {{(pid=86474) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] ******************************************************************************** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Configuration options gathered from: {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 19 13:01:57 devstack cinder-volume[86690]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] ================================================================================ {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] allow_availability_zone_fallback = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] allow_compression_on_image_upload = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] allowed_direct_url_schemes = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] api_rate_limit = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] auth_strategy = keystone {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_availability_zone = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_host = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_stats_polling_interval = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backup_api_class = cinder.backup.api.API {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backup_name_template = backup-%s {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backup_use_same_host = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backup_use_temp_snapshot = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] chap_password = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] chap_username = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_internal_tenant_project_id = c90f2bc8ca484b279f26d44065aab219 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_internal_tenant_user_id = 0442d812698f4433a7f05b7390826da2 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cluster = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] compression_format = gzip {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] compute_api_class = cinder.compute.nova.API {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] config_dir = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] config_source = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] control_exchange = openstack {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] debug = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] default_availability_zone = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] default_group_type = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] default_volume_type = QuobyteHD {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] disk_geometry = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] driver_client_cert = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] driver_client_cert_key = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] driver_data_namespace = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] driver_ssl_cert_path = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] driver_ssl_cert_verify = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] driver_use_ssl = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] enable_new_services = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] enable_unsupported_driver = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] enabled_backends = ['QuobyteHD'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] enforce_multipath_for_image_xfer = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] filter_function = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_api_insecure = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_api_ssl_compression = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_ca_certificates_file = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_catalog_info = image:glance:publicURL {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_num_retries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance_request_timeout = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] goodness_function = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] graceful_shutdown_timeout = 5 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] group_api_class = cinder.group.api.API {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] host = devstack {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_compress_on_upload = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_conversion_address_space_limit = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_conversion_cpu_limit = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_conversion_disable = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_upload_use_cinder_backend = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_upload_use_internal_tenant = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_volume_cache_enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_volume_cache_max_count = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] image_volume_cache_max_size_gb = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] init_host_max_objects_retrieval = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] instance_format = [instance: %(uuid)s] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] iscsi_target_flags = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] iscsi_write_cache = on {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] iser_helper = tgtadm {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] iser_ip_address = 192.168.122.240 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] iser_port = 3260 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_color = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_config_append = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_dir = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_file = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_options = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_rotate_interval = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_rotate_interval_type = days {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] log_rotation_type = none {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] max_age = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] max_logfile_count = 30 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] max_logfile_size_mb = 200 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] max_over_subscription_ratio = 20.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] message_reap_interval = 86400 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] message_ttl = 2592000 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] migration_create_volume_timeout_secs = 300 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] monkey_patch = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86690]: INFO cinder.volume.manager [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Starting volume driver QuobyteDriver (1.2) Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.remotefs [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86690) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] monkey_patch_modules = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] my_ip = 192.168.122.240 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] no_snapshot_gb_quota = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] num_iser_scan_tries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] num_shell_tries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] num_volume_device_scan_tries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] nvmeof_conn_info_version = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] nvmet_ns_id = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] nvmet_port_id = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] osapi_max_limit = 1000 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] osapi_volume_ext_list = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] osapi_volume_listen_port = 8776 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] osapi_volume_use_ssl = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] osapi_volume_workers = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] per_volume_size_limit = -1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] periodic_fuzzy_delay = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] periodic_interval = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] public_endpoint = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] publish_errors = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] quota_backup_gigabytes = 1000 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] quota_backups = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] quota_gigabytes = 1000 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] quota_groups = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] quota_snapshots = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] quota_volumes = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] rate_limit_burst = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] rate_limit_except_level = CRITICAL {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] rate_limit_interval = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] reinit_driver_count = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] replication_device = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] report_discard_supported = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] report_interval = 120 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] reservation_clean_interval = 86400 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] reservation_expire = 86400 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] reserved_image_namespaces = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] reserved_percentage = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] rpc_response_timeout = 120 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] run_external_periodic_tasks = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] scst_target_driver = iscsi {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] scst_target_iqn_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_down_time = 720 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] shell_completion = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] snapshot_name_template = snapshot-%s {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] split_loggers = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] state_path = /opt/stack/data/cinder {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] storage_availability_zone = nova {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] storage_protocol = iSCSI {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] syslog_log_facility = LOG_USER {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] target_helper = lioadm {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] target_ip_address = 192.168.122.240 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] target_port = 3260 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] target_protocol = iscsi {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] target_secondary_ip_addresses = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] trace_flags = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] transport_url = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] until_refresh = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] use_chap_auth = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] use_default_quota_class = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] use_journal = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] use_json = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] use_multipath_for_image_xfer = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] use_stderr = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] use_syslog = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] verify_glance_signatures = enabled {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_api_class = cinder.volume.api.API {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_backend_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_clear = zero {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_clear_ionice = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_clear_size = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_copy_bps_limit = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_dd_blocksize = 1M {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_name_template = volume-%s {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_service_inithost_offload = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volume_usage_audit_period = month {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] zoning_mode = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86690) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_concurrency.disable_process_locking = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: WARNING cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 19 13:01:57 devstack cinder-volume[86690]: WARNING cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Running cmd (subprocess): mount.quobyte {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.auth_section = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.auth_type = password {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.auth_version = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.cache = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.include_service_catalog = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.insecure = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.interface = public {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_password = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcache_username = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.region_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.service_type = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.backend = dogpile.cache.null {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.backend_argument = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.backend_expiration_time = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.config_prefix = cache.oslo {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.debug_cache_backend = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.enable_retry_client = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.enable_socket_keepalive = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.expiration_time = 600 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.hashclient_retry_attempts = 2 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.memcache_dead_retry = 300 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.memcache_pool_maxsize = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.memcache_sasl_enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.password = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.proxies = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.redis_db = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.redis_server = localhost:6379 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.retry_attempts = 2 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.retry_delay = 0.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.socket_keepalive_count = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.socket_keepalive_idle = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.socket_keepalive_interval = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.socket_timeout = 1.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.tls_allowed_ciphers = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.tls_cafile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.tls_certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.tls_enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.tls_keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cache.username = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] coordination.backend_url = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.asyncio_connection = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.asyncio_slave_connection = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.backend = sqlalchemy {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.connection = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.connection_debug = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.connection_parameters = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.connection_recycle_time = 3600 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.connection_trace = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.db_inc_retry_interval = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.db_max_retries = 20 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.db_max_retry_interval = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.db_retry_interval = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.max_overflow = 50 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.max_pool_size = 5 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.max_retries = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.mysql_wsrep_sync_wait = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.pool_timeout = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.retry_interval = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.slave_connection = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.sqlite_synchronous = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.synchronous_reader = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] database.use_db_reconnect = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.connection_string = messaging:// {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.es_doc_type = notification {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.es_scroll_size = 10000 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.es_scroll_time = 2m {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.filter_error_trace = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.hmac_keys = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.sentinel_service_name = mymaster {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.socket_timeout = 0.1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.trace_requests = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler.trace_sqlalchemy = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler_jaeger.process_tags = {} {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler_jaeger.service_name_prefix = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] profiler_otlp.service_name_prefix = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.enforce_new_defaults = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.policy_default_rule = default {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.policy_file = policy.yaml {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] privsep_osbrick.group = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] privsep_osbrick.helper_command = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] privsep_osbrick.user = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_sys_admin.group = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_sys_admin.helper_command = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] cinder_sys_admin.user = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.auth_section = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.auth_type = password {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.cafile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.collect_timing = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.insecure = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.send_service_user_token = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.split_loggers = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] service_user.timeout = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.auth_section = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.auth_type = password {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.collect_timing = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.insecure = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.region_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.split_loggers = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] glance.timeout = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.backend_availability_zone = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.chap_password = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.chap_username = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.disk_geometry = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.driver_client_cert = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.driver_client_cert_key = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.driver_data_namespace = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.driver_use_ssl = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.extra_capabilities = {} {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.filter_function = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.goodness_function = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.iscsi_target_flags = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.iscsi_write_cache = on {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.iser_helper = tgtadm {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.iser_port = 3260 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_host = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_login = admin {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_mount_options = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_password = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_private_key = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_share_path = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.num_shell_tries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.quobyte_volume_url = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.replication_device = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.report_discard_supported = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.reserved_percentage = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.target_helper = tgtadm {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack quobyte-client[86695]: Reading configuration file: /etc/quobyte/client.cfg Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.target_port = 3260 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.target_protocol = iscsi {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.trace_flags = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack quobyte-client[86695]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.unique_fqdn_network = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.use_chap_auth = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_backend_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_clear = zero {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_clear_ionice = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_clear_size = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_reports.file_event_handler = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_reports.log_dir = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.backend_availability_zone = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.backend_host = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.chap_password = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.chap_username = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.chiscsi_conf = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.disk_geometry = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.driver_client_cert = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.driver_data_namespace = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.driver_use_ssl = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.extra_capabilities = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.filter_function = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=86690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.goodness_function = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: INFO cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 ... Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.iser_helper = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.iser_ip_address = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb -c /etc/quobyte/client-cinder.cfg {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.iser_port = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.iser_target_prefix = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_host = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_login = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_mount_options = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_password = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_private_key = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_share_path = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_ssh_port = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.num_shell_tries = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.nvmet_port_id = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.replication_device = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.report_discard_supported = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.reserved_percentage = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.scst_target_driver = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.storage_protocol = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.target_helper = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.target_ip_address = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.target_port = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.target_prefix = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.target_protocol = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.trace_flags = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.use_chap_auth = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_clear = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_clear_size = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] QuobyteHD.volumes_dir = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.ssl = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_notifications.driver = [] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_notifications.retry = -1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] key_manager.fixed_key = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.barbican_api_version = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.barbican_endpoint = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.barbican_endpoint_type = public {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.barbican_region_name = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.cafile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.collect_timing = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.insecure = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.number_of_retries = 60 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.retry_delay = 1 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.send_service_user_token = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.split_loggers = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.timeout = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.verify_ssl = True {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican.verify_ssl_path = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.auth_section = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.auth_type = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.cafile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.certfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.collect_timing = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.insecure = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.keyfile = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.split_loggers = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] barbican_service_user.timeout = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.approle_role_id = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.approle_secret_id = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.auth_method = approle {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.auth_path = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.kv_mountpoint = secret {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.kv_path = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.kv_version = 2 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.namespace = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.root_token_id = **** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.ssl_ca_crt_file = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.timeout = 60.0 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.token_file = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.token_role = None {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.use_ssl = False {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:01:57 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] ******************************************************************************** {{(pid=86474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 19 13:01:57 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb -c /etc/quobyte/client-cinder.cfg Jul 19 13:01:57 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:58 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.401s {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:58 devstack cinder-volume[86690]: INFO cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 succeeded Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=86690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.413s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:58 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:01:58 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:58 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.244s {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:58 devstack cinder-volume[86690]: INFO cinder.volume.driver [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Driver hasn't implemented _init_vendor_properties() Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.volume.driver [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86690) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_db.sqlalchemy.engines [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG dbcounter [-] [86690] Writer thread running {{(pid=86690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.db.api [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Building query based on filter {{(pid=86690) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.image.image_utils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86690) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 19 13:01:58 devstack cinder-volume[86690]: INFO cinder.keymgr.migration [None req-2be0f9c4-cfed-491f-bbcd-c76c3b40e37f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=86690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=86690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:58 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:01:58 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:58 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.227s {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.manager [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Notifying Schedulers of capabilities ... {{(pid=86690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:01:58 devstack cinder-volume[86690]: INFO cinder.volume.manager [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Driver initialization completed successfully. Jul 19 13:01:58 devstack cinder-volume[86690]: INFO cinder.manager [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Initiating service 3 cleanup Jul 19 13:01:58 devstack cinder-volume[86690]: INFO cinder.manager [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Service 3 cleanup completed. Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.service [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Creating RPC server for service cinder-volume {{(pid=86690) start /opt/stack/cinder/cinder/service.py:231}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.service [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86690) start /opt/stack/cinder/cinder/service.py:237}} Jul 19 13:01:58 devstack cinder-volume[86690]: INFO cinder.volume.manager [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=86690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=86690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:01:58 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:01:58 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:01:58 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:01:59 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Jul 19 13:01:59 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.243s {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:01:59 devstack cinder-volume[86690]: INFO cinder.volume.manager [None req-a8b295f7-d5e5-416c-b921-ffe27ab949dc None None] Driver post RPC initialization completed successfully. Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=86690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG cinder.volume.drivers.quobyte [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=86690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86690) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:02:03 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:02:03 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:02:03 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG oslo_concurrency.processutils [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.238s {{(pid=86690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:02:03 devstack cinder-volume[86690]: DEBUG cinder.manager [None req-6593bc3b-a5cc-4bba-a521-8906a0c3f8b1 None None] Notifying Schedulers of capabilities ... {{(pid=86690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:02:04 devstack cinder-volume[86474]: INFO oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Caught SIGTERM, stopping children Jul 19 13:02:04 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Acquiring lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 13:02:04 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Acquired lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 13:02:04 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Releasing lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 13:02:04 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Stop services. {{(pid=86474) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 19 13:02:04 devstack cinder-volume[86474]: DEBUG oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Killing children. {{(pid=86474) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 19 13:02:04 devstack cinder-volume[86474]: INFO oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Waiting on 1 children to exit Jul 19 13:02:07 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Acquiring lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 13:02:07 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Acquired lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 13:02:07 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Releasing lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 13:02:07 devstack cinder-volume[86690]: WARNING amqp [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 13:02:07 devstack cinder-volume[86690]: WARNING amqp [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 13:02:07 devstack cinder-volume[86474]: INFO oslo_service.backend._eventlet.service [None req-a0a59ebc-43cd-4318-aa69-ef2c3670be2b None None] Child 86690 exited with status 0 Jul 19 13:02:07 devstack cinder-volume[87009]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 19 13:02:07 devstack cinder-volume[87009]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 13:02:07 devstack cinder-volume[87009]: we strongly recommend against using it for new projects. Jul 19 13:02:07 devstack cinder-volume[87009]: If you are already using Eventlet, we recommend migrating to a different Jul 19 13:02:07 devstack cinder-volume[87009]: framework. For more detail see Jul 19 13:02:07 devstack cinder-volume[87009]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 13:02:07 devstack cinder-volume[87009]: import eventlet # noqa Jul 19 13:02:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 13:02:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 13:02:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 13:02:11 devstack cinder-volume[87009]: INFO dbcounter [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Registered counter for database cinder Jul 19 13:02:11 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:02:11 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writer thread running {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 13:02:11 devstack cinder-volume[87009]: INFO cinder.rpc [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 19 13:02:11 devstack cinder-volume[87009]: INFO cinder.rpc [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 19 13:02:11 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:02:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Determined volume DB was empty at startup. Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87009) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 19 13:02:12 devstack cinder-volume[87009]: WARNING stevedore.named [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 13:02:12 devstack cinder-volume[87009]: WARNING castellan.key_manager [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 13:02:12 devstack cinder-volume[87009]: WARNING cinder.keymgr.conf_key_mgr [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 13:02:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:02:12 devstack cinder-volume[87009]: INFO oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Starting 1 workers Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Started child 87305 {{(pid=87009) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Full set of CONF: {{(pid=87009) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] ******************************************************************************** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] Configuration options gathered from: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] ================================================================================ {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 19 13:02:12 devstack cinder-volume[87305]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] allow_availability_zone_fallback = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] allow_compression_on_image_upload = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] allowed_direct_url_schemes = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] api_rate_limit = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] auth_strategy = keystone {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_host = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_stats_polling_interval = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backup_api_class = cinder.backup.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backup_name_template = backup-%s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backup_use_same_host = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backup_use_temp_snapshot = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] chap_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] chap_username = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_internal_tenant_project_id = c90f2bc8ca484b279f26d44065aab219 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_internal_tenant_user_id = 0442d812698f4433a7f05b7390826da2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cluster = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] compression_format = gzip {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] compute_api_class = cinder.compute.nova.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] config_dir = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] config_source = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] control_exchange = openstack {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] debug = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] default_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] default_group_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] default_volume_type = QuobyteHD {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] disk_geometry = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] driver_client_cert = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] driver_client_cert_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] driver_data_namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] driver_ssl_cert_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] driver_ssl_cert_verify = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] driver_use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] enable_new_services = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] enable_unsupported_driver = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] enabled_backends = ['QuobyteHD'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] enforce_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] filter_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_api_insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_api_ssl_compression = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_ca_certificates_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_catalog_info = image:glance:publicURL {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_num_retries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance_request_timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] goodness_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] graceful_shutdown_timeout = 5 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] group_api_class = cinder.group.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] host = devstack {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_compress_on_upload = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_conversion_address_space_limit = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_conversion_cpu_limit = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_conversion_disable = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_upload_use_cinder_backend = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_upload_use_internal_tenant = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_volume_cache_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_volume_cache_max_count = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] image_volume_cache_max_size_gb = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] init_host_max_objects_retrieval = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] instance_format = [instance: %(uuid)s] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] iscsi_target_flags = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] iscsi_write_cache = on {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] iser_helper = tgtadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] iser_ip_address = 192.168.122.240 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] iser_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_color = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_config_append = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_dir = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_options = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_rotate_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_rotate_interval_type = days {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] log_rotation_type = none {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] max_age = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] max_logfile_count = 30 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] max_logfile_size_mb = 200 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] max_over_subscription_ratio = 20.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] message_reap_interval = 86400 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] message_ttl = 2592000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] migration_create_volume_timeout_secs = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] monkey_patch = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] monkey_patch_modules = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] my_ip = 192.168.122.240 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] no_snapshot_gb_quota = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] num_iser_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] num_shell_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] num_volume_device_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Starting volume driver QuobyteDriver (1.2) Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] nvmeof_conn_info_version = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87305) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] nvmet_ns_id = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] nvmet_port_id = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] osapi_max_limit = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] osapi_volume_ext_list = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] osapi_volume_listen_port = 8776 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] osapi_volume_use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] osapi_volume_workers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] per_volume_size_limit = -1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] periodic_fuzzy_delay = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] periodic_interval = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] public_endpoint = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] publish_errors = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] quota_backup_gigabytes = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] quota_backups = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] quota_gigabytes = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] quota_groups = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] quota_snapshots = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] quota_volumes = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] rate_limit_burst = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] rate_limit_except_level = CRITICAL {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] rate_limit_interval = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] reinit_driver_count = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] replication_device = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] report_discard_supported = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] report_interval = 120 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] reservation_clean_interval = 86400 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] reservation_expire = 86400 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] reserved_image_namespaces = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] reserved_percentage = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] rpc_response_timeout = 120 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] run_external_periodic_tasks = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] scst_target_driver = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] scst_target_iqn_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_down_time = 720 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] shell_completion = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] snapshot_name_template = snapshot-%s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] state_path = /opt/stack/data/cinder {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] storage_availability_zone = nova {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] storage_protocol = iSCSI {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] syslog_log_facility = LOG_USER {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] target_helper = lioadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] target_ip_address = 192.168.122.240 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] target_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] target_protocol = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] target_secondary_ip_addresses = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] trace_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] transport_url = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] until_refresh = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] use_chap_auth = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] use_default_quota_class = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] use_journal = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] use_json = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] use_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] use_stderr = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] use_syslog = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] verify_glance_signatures = enabled {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_api_class = cinder.volume.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_backend_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_clear = zero {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_clear_ionice = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_clear_size = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_copy_bps_limit = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_dd_blocksize = 1M {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_name_template = volume-%s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_service_inithost_offload = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volume_usage_audit_period = month {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] zoning_mode = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_concurrency.disable_process_locking = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.auth_type = password {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.auth_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.cache = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.include_service_catalog = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.interface = public {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_password = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcache_username = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.region_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.service_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.backend = dogpile.cache.null {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.backend_argument = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.backend_expiration_time = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.config_prefix = cache.oslo {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.debug_cache_backend = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.enable_retry_client = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.enable_socket_keepalive = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.expiration_time = 600 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.hashclient_retry_attempts = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.memcache_dead_retry = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.memcache_pool_maxsize = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.memcache_sasl_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.proxies = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.redis_db = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.redis_server = localhost:6379 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.retry_attempts = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.retry_delay = 0.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.socket_keepalive_count = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.socket_keepalive_idle = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.socket_keepalive_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.socket_timeout = 1.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.tls_allowed_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.tls_cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.tls_certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.tls_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.tls_keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cache.username = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] coordination.backend_url = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.asyncio_connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.asyncio_slave_connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.backend = sqlalchemy {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.connection_debug = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.connection_parameters = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.connection_recycle_time = 3600 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.connection_trace = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.db_inc_retry_interval = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.db_max_retries = 20 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.db_max_retry_interval = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.db_retry_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.max_overflow = 50 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.max_pool_size = 5 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.max_retries = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.mysql_wsrep_sync_wait = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.pool_timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.retry_interval = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.slave_connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.sqlite_synchronous = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.synchronous_reader = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] database.use_db_reconnect = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.connection_string = messaging:// {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.es_doc_type = notification {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.es_scroll_size = 10000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.es_scroll_time = 2m {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.filter_error_trace = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.hmac_keys = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.sentinel_service_name = mymaster {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.socket_timeout = 0.1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.trace_requests = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler.trace_sqlalchemy = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler_jaeger.process_tags = {} {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler_jaeger.service_name_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] profiler_otlp.service_name_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.enforce_new_defaults = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.policy_default_rule = default {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.policy_file = policy.yaml {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] privsep_osbrick.group = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] privsep_osbrick.helper_command = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] privsep_osbrick.user = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_sys_admin.group = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_sys_admin.helper_command = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] cinder_sys_admin.user = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.auth_type = password {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.send_service_user_token = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] service_user.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.auth_type = password {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.region_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] glance.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.backend_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.chap_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.chap_username = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.disk_geometry = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.driver_client_cert = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.driver_client_cert_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.driver_data_namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.driver_use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.extra_capabilities = {} {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.filter_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.goodness_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.iscsi_target_flags = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.iscsi_write_cache = on {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.iser_helper = tgtadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.iser_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_host = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_login = admin {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_mount_options = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_private_key = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_share_path = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.num_shell_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.quobyte_volume_url = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.replication_device = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.report_discard_supported = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.reserved_percentage = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.target_helper = tgtadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.target_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.target_protocol = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.trace_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.unique_fqdn_network = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.use_chap_auth = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_backend_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_clear = zero {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_clear_ionice = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_clear_size = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_reports.file_event_handler = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_reports.log_dir = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.backend_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.backend_host = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.chap_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.chap_username = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.chiscsi_conf = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.disk_geometry = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.driver_client_cert = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.driver_data_namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.driver_use_ssl = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.extra_capabilities = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.filter_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.goodness_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87305) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 19 13:02:12 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.iser_helper = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.iser_ip_address = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.iser_port = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.iser_target_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_host = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_login = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_mount_options = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_private_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_share_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_ssh_port = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Running cmd (subprocess): mount.quobyte {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.num_shell_tries = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.nvmet_port_id = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.replication_device = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.report_discard_supported = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.reserved_percentage = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.scst_target_driver = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.storage_protocol = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.target_helper = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.target_ip_address = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.target_port = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.target_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.target_protocol = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.trace_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.use_chap_auth = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_clear = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_clear_size = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] QuobyteHD.volumes_dir = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_notifications.driver = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_notifications.retry = -1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] key_manager.fixed_key = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.barbican_api_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.barbican_endpoint = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.barbican_endpoint_type = public {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.barbican_region_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.number_of_retries = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.retry_delay = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.send_service_user_token = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.verify_ssl = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican.verify_ssl_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.auth_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] barbican_service_user.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.approle_role_id = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.approle_secret_id = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.auth_method = approle {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.auth_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.kv_mountpoint = secret {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.kv_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.kv_version = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.root_token_id = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.ssl_ca_crt_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.timeout = 60.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.token_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.token_role = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 13:02:12 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-c7a4b472-8778-4e48-be83-5bd7edb39938 None None] ******************************************************************************** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 19 13:02:12 devstack quobyte-client[87306]: Reading configuration file: /etc/quobyte/client.cfg Jul 19 13:02:12 devstack quobyte-client[87306]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:02:12 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:02:12 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:02:12 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.236s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:02:12 devstack cinder-volume[87305]: INFO cinder.volume.driver [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Driver hasn't implemented _init_vendor_properties() Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.volume.driver [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87305) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_db.sqlalchemy.engines [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87305) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writer thread running {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.db.api [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Building query based on filter {{(pid=87305) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87305) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:02:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:02:12 devstack cinder-volume[87305]: INFO cinder.keymgr.migration [None req-361bed8e-efa0-4086-9155-ce4be1d828a9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 19 13:02:12 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:02:12 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:02:13 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.229s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:02:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Driver initialization completed successfully. Jul 19 13:02:13 devstack cinder-volume[87305]: INFO cinder.manager [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Initiating service 3 cleanup Jul 19 13:02:13 devstack cinder-volume[87305]: INFO cinder.manager [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Service 3 cleanup completed. Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG cinder.service [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Creating RPC server for service cinder-volume {{(pid=87305) start /opt/stack/cinder/cinder/service.py:231}} Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG cinder.service [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87305) start /opt/stack/cinder/cinder/service.py:237}} Jul 19 13:02:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:02:13 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:02:13 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:02:13 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Jul 19 13:02:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:02:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-be29b26f-60f6-4548-9d9a-631361674888 None None] Driver post RPC initialization completed successfully. Jul 19 13:02:22 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:02:23 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:02:23 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:02:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:02:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 6 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:02:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Flow 'volume_create_manager' (6f5687fd-96a2-4373-8d1a-d34e71c2c308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a60a46-ce08-43a4-81d0-022f74067cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a60a46-ce08-43a4-81d0-022f74067cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1752204228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31321742-f75a-481e-9096-66ba9bfac834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9e4a16a05b4237ab66315621e0e276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:03:39Z,use_quota=True,user_id='124505d6991142bf9ca63fc1b89707a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3dc503-df88-4c97-9569-1d60a4232f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3dc503-df88-4c97-9569-1d60a4232f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16cba0a-8f3b-45e7-951d-e11ee6b31927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16cba0a-8f3b-45e7-951d-e11ee6b31927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31321742-f75a-481e-9096-66ba9bfac834', 'volume_name': 'volume-31321742-f75a-481e-9096-66ba9bfac834', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85cdc54-d997-4518-b76e-626e323d0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85cdc54-d997-4518-b76e-626e323d0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68628755-7ca6-4146-a521-af4e61cd0a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:39 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Volume 31321742-f75a-481e-9096-66ba9bfac834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31321742-f75a-481e-9096-66ba9bfac834', 'volume_size': 1} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1752204228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31321742-f75a-481e-9096-66ba9bfac834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9e4a16a05b4237ab66315621e0e276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:03:39Z,use_quota=True,user_id='124505d6991142bf9ca63fc1b89707a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Creating volume 31321742-f75a-481e-9096-66ba9bfac834 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:03:39 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:03:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:39 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 1073741824 Jul 19 13:03:39 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Flow 'volume_create_manager' (0efd9638-e5a2-44be-a8b3-36b69c81a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab155c2e-3f66-4593-9b01-79e378a6693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab155c2e-3f66-4593-9b01-79e378a6693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-918713801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84a131e-0412-4c03-960c-f6fb37545bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe8360d18f749d5a7635ece755c0e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:03:40Z,use_quota=True,user_id='737d0b9a3d9c41a0a563cf0417caf03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643d89cd-1ff3-41cb-9c6f-a9025c536edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643d89cd-1ff3-41cb-9c6f-a9025c536edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c98a507-3c86-4fbd-903f-7c5be6624909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c98a507-3c86-4fbd-903f-7c5be6624909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84a131e-0412-4c03-960c-f6fb37545bda', 'volume_name': 'volume-a84a131e-0412-4c03-960c-f6fb37545bda', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf314b32-f8c7-431a-a70b-78c09bfaaa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf314b32-f8c7-431a-a70b-78c09bfaaa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3f82e3-5a13-46df-96da-ef133ef30b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Volume a84a131e-0412-4c03-960c-f6fb37545bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84a131e-0412-4c03-960c-f6fb37545bda', 'volume_size': 1} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:40 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 1073741824" returned: 0 in 1.020s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:40 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 Jul 19 13:03:40 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:41 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834" returned: 0 in 0.520s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-918713801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84a131e-0412-4c03-960c-f6fb37545bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe8360d18f749d5a7635ece755c0e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:03:40Z,use_quota=True,user_id='737d0b9a3d9c41a0a563cf0417caf03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Creating volume a84a131e-0412-4c03-960c-f6fb37545bda {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:03:41 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68628755-7ca6-4146-a521-af4e61cd0a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31321742-f75a-481e-9096-66ba9bfac834', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b2d345-c4de-4688-8144-5a247744ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:41 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda 1073741824 Jul 19 13:03:41 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Volume volume-31321742-f75a-481e-9096-66ba9bfac834 (31321742-f75a-481e-9096-66ba9bfac834): created successfully Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b2d345-c4de-4688-8144-5a247744ce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Flow 'volume_create_manager' (6f5687fd-96a2-4373-8d1a-d34e71c2c308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:03:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-432a7951-c6d2-4e8e-89b9-4db8bd1907af tempest-VolumesAdminNegativeTest-1431788733 None] Created volume successfully. Jul 19 13:03:42 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda 1073741824" returned: 0 in 0.949s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:42 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda Jul 19 13:03:42 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:42 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:03:42 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Acquiring lock "cinder-31321742-f75a-481e-9096-66ba9bfac834-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Lock "cinder-31321742-f75a-481e-9096-66ba9bfac834-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Acquiring lock "cinder-quobyte-31321742-f75a-481e-9096-66ba9bfac834" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Lock "cinder-quobyte-31321742-f75a-481e-9096-66ba9bfac834" acquired by "delete_volume" :: waited 0.057s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:03:42 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:42 devstack cinder-volume[87305]: INFO oslo.privsep.daemon [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu6pp_qp6/privsep.sock'] Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda" returned: 0 in 0.655s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:42 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu6pp_qp6/privsep.sock Jul 19 13:03:42 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3f82e3-5a13-46df-96da-ef133ef30b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84a131e-0412-4c03-960c-f6fb37545bda', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2024d992-3f38-4fa5-b098-2cfeff2a6f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:42 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Volume volume-a84a131e-0412-4c03-960c-f6fb37545bda (a84a131e-0412-4c03-960c-f6fb37545bda): created successfully Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2024d992-3f38-4fa5-b098-2cfeff2a6f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Flow 'volume_create_manager' (0efd9638-e5a2-44be-a8b3-36b69c81a536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:03:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-add32b0a-460a-4153-8c01-0d1987ae3a63 tempest-ServerRescueNegativeTestJSON-317582887 None] Created volume successfully. Jul 19 13:03:43 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.834s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:43 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:03:43 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:03:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 7 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:03:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: Jul 19 13:03:44 devstack cinder-volume[87305]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 19 13:03:45 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:45 devstack cinder-volume[87305]: INFO oslo.privsep.daemon [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Spawned new privsep daemon via rootwrap Jul 19 13:03:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Accepted privsep connection to /tmp/tmpu6pp_qp6/privsep.sock {{(pid=87305) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 19 13:03:45 devstack cinder-volume[87305]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 19 13:03:45 devstack cinder-volume[87305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 19 13:03:45 devstack cinder-volume[87305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 19 13:03:45 devstack cinder-volume[87305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88583 Jul 19 13:03:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc5800-dc17-4cdd-b6d3-6b31292d5c69]: (2,) {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:03:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf9dc6-d265-4ab2-b14c-de1beeb93b6a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:03:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:45 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 Jul 19 13:03:45 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:45 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834" returned: 0 in 0.630s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:45 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834 Jul 19 13:03:45 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:46 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-31321742-f75a-481e-9096-66ba9bfac834" returned: 0 in 0.583s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Lock "cinder-quobyte-31321742-f75a-481e-9096-66ba9bfac834" released by "delete_volume" :: held 3.746s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:03:46 devstack cinder-volume[87305]: WARNING cinder.quota [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:03:46 devstack cinder-volume[87305]: WARNING cinder.quota [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:03:46 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Created reservations ['483ed7cf-bda6-4876-8c2b-4b83374b7a58', '5f0f747d-b881-419d-ad5f-4139f0c7dd11', '90ce108c-4ff3-41f2-a288-f8ef213f8d23', '19c70484-e56d-4972-9337-f3b635a226ce'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:47 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:03:47 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:47 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.507s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:03:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Deleted volume successfully. Jul 19 13:03:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d5f33a46-5f56-486f-b3d4-7eb42a48acbc tempest-VolumesAdminNegativeTest-1431788733 None] Lock "cinder-31321742-f75a-481e-9096-66ba9bfac834-delete_volume" released by "delete_volume" :: held 5.107s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Flow 'volume_create_manager' (48218809-9261-4626-b9b5-e54d98e4daea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf349c1-c1f8-4e2d-bc39-a1823d6d9c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf349c1-c1f8-4e2d-bc39-a1823d6d9c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-145350006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584caa47-0a8c-4d62-9cf2-fbc3d9faa963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5059fa9d441d4dea8e66cda3185b676f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:03:57Z,use_quota=True,user_id='ac1b32f630bb41e8aa43ed7eb86c8139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e49691-978a-4de1-9a24-5cd13ae0db38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e49691-978a-4de1-9a24-5cd13ae0db38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0633053e-a1f6-4e27-8060-6801c91ff464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0633053e-a1f6-4e27-8060-6801c91ff464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584caa47-0a8c-4d62-9cf2-fbc3d9faa963', 'volume_name': 'volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5bfd35-68b9-431d-8d15-0d2614d330dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5bfd35-68b9-431d-8d15-0d2614d330dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37157aaf-5c9e-48ef-ac4c-efc70c2a947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Volume 584caa47-0a8c-4d62-9cf2-fbc3d9faa963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963', 'volume_size': 1} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-145350006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584caa47-0a8c-4d62-9cf2-fbc3d9faa963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5059fa9d441d4dea8e66cda3185b676f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:03:57Z,use_quota=True,user_id='ac1b32f630bb41e8aa43ed7eb86c8139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Creating volume 584caa47-0a8c-4d62-9cf2-fbc3d9faa963 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:03:57 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:03:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:57 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 1073741824 Jul 19 13:03:57 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:58 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 1073741824" returned: 0 in 0.587s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:58 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 Jul 19 13:03:58 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:58 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963" returned: 0 in 0.435s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37157aaf-5c9e-48ef-ac4c-efc70c2a947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911a4e19-e866-47ee-963c-104ec1f1e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:03:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Volume volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 (584caa47-0a8c-4d62-9cf2-fbc3d9faa963): created successfully Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911a4e19-e866-47ee-963c-104ec1f1e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Flow 'volume_create_manager' (48218809-9261-4626-b9b5-e54d98e4daea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Acquiring lock "cinder-a84a131e-0412-4c03-960c-f6fb37545bda-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:03:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bcdd31ac-8637-4bb7-8434-751719e8167c tempest-ServerActionsTestOtherA-354257058 None] Created volume successfully. Jul 19 13:03:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "cinder-a84a131e-0412-4c03-960c-f6fb37545bda-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Acquiring lock "cinder-quobyte-a84a131e-0412-4c03-960c-f6fb37545bda" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "cinder-quobyte-a84a131e-0412-4c03-960c-f6fb37545bda" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b794846-df20-4e3c-ad46-f04975c48fbf]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:59 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda Jul 19 13:03:59 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:59 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda" returned: 0 in 0.401s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:03:59 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda Jul 19 13:03:59 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:03:59 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a84a131e-0412-4c03-960c-f6fb37545bda" returned: 0 in 0.335s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "cinder-quobyte-a84a131e-0412-4c03-960c-f6fb37545bda" released by "delete_volume" :: held 0.790s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:03:59 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Created reservations ['6a442ed5-98e6-4b47-8c49-4781a9c8c678', 'dafda2b2-cf70-4873-8336-4b3369843ae5', '13604ddf-c761-4d40-afd8-db3de5c262ab', '45db1beb-90a0-4b35-b091-cbb0b440a94b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:04:00 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:04:00 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:04:00 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.496s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:04:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Deleted volume successfully. Jul 19 13:04:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-36b9d2f5-9bb8-4882-b18e-a5320aff6dd4 tempest-ServerRescueNegativeTestJSON-317582887 None] Lock "cinder-a84a131e-0412-4c03-960c-f6fb37545bda-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:04:10 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:04:10 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Flow 'volume_create_manager' (dd94ffd6-4397-487d-9d1d-b62c1e108fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d952199-75fd-44e6-8d35-37f367ff18bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d952199-75fd-44e6-8d35-37f367ff18bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-249886917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f74177-c282-49e7-9822-b12cb9022918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ce08ee4abcd4e5cb8419ae128e471ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:04:23Z,use_quota=True,user_id='d57894999b384344b727072c1df1bca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47115af1-18e5-4c4d-bd3a-5ab2ebdeca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47115af1-18e5-4c4d-bd3a-5ab2ebdeca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd60d71f-5fe6-4114-b246-4de957f91e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd60d71f-5fe6-4114-b246-4de957f91e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f74177-c282-49e7-9822-b12cb9022918', 'volume_name': 'volume-91f74177-c282-49e7-9822-b12cb9022918', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7907cb-9096-4486-b699-f149bfc28ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7907cb-9096-4486-b699-f149bfc28ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c666f7-2b1d-4789-ade2-e43c083bbc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:04:23 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Volume 91f74177-c282-49e7-9822-b12cb9022918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f74177-c282-49e7-9822-b12cb9022918', 'volume_size': 1} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-249886917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f74177-c282-49e7-9822-b12cb9022918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ce08ee4abcd4e5cb8419ae128e471ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:04:23Z,use_quota=True,user_id='d57894999b384344b727072c1df1bca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Creating volume 91f74177-c282-49e7-9822-b12cb9022918 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:04:23 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:04:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:04:23 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 1073741824 Jul 19 13:04:23 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:04:24 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Jul 19 13:04:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 1073741824" returned: 0 in 0.833s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:04:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:04:24 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 Jul 19 13:04:24 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:04:25 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Jul 19 13:04:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918" returned: 0 in 0.691s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:04:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:04:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c666f7-2b1d-4789-ade2-e43c083bbc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f74177-c282-49e7-9822-b12cb9022918', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:04:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a29b866-4630-4a61-b826-7e679e88c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:04:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Volume volume-91f74177-c282-49e7-9822-b12cb9022918 (91f74177-c282-49e7-9822-b12cb9022918): created successfully Jul 19 13:04:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a29b866-4630-4a61-b826-7e679e88c519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:04:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Flow 'volume_create_manager' (dd94ffd6-4397-487d-9d1d-b62c1e108fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:04:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3a23f952-139b-4556-af8d-aad2205dd8bc tempest-DeleteServersTestJSON-1060722982 None] Created volume successfully. Jul 19 13:04:30 devstack cinder-volume[87305]: WARNING py.warnings [req-6ff5d05f-66bb-40a2-a404-fc2a349d8bde req-2191daef-5fd4-43ae-b14b-ff98a5219586 tempest-DeleteServersTestJSON-1060722982 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 19 13:04:30 devstack cinder-volume[87305]: .first() Jul 19 13:04:30 devstack cinder-volume[87305]: Jul 19 13:04:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-6ff5d05f-66bb-40a2-a404-fc2a349d8bde req-2191daef-5fd4-43ae-b14b-ff98a5219586 tempest-DeleteServersTestJSON-1060722982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-6ff5d05f-66bb-40a2-a404-fc2a349d8bde req-2191daef-5fd4-43ae-b14b-ff98a5219586 tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-6ff5d05f-66bb-40a2-a404-fc2a349d8bde req-2191daef-5fd4-43ae-b14b-ff98a5219586 tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-6ff5d05f-66bb-40a2-a404-fc2a349d8bde req-2191daef-5fd4-43ae-b14b-ff98a5219586 tempest-DeleteServersTestJSON-1060722982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-91f74177-c282-49e7-9822-b12cb9022918', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15a10d3d-6274-4ad5-9eb8-e7b95b035171', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:04:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-6ff5d05f-66bb-40a2-a404-fc2a349d8bde req-2191daef-5fd4-43ae-b14b-ff98a5219586 tempest-DeleteServersTestJSON-1060722982 None] attachment_update completed successfully. Jul 19 13:04:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-a949199c-e2b1-4f00-89bb-dee40347d7d7 req-0a00f78d-41c0-4d4f-9a7e-af8a975791ce tempest-DeleteServersTestJSON-1060722982 None] Terminate volume connection completed successfully. Jul 19 13:04:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-a949199c-e2b1-4f00-89bb-dee40347d7d7 req-0a00f78d-41c0-4d4f-9a7e-af8a975791ce tempest-DeleteServersTestJSON-1060722982 None] Deleting attachment 15a10d3d-6274-4ad5-9eb8-e7b95b035171. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:04:42 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:04:42 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:04:42 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 8 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:04:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Acquiring lock "cinder-91f74177-c282-49e7-9822-b12cb9022918-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Lock "cinder-91f74177-c282-49e7-9822-b12cb9022918-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Acquiring lock "cinder-quobyte-91f74177-c282-49e7-9822-b12cb9022918" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Lock "cinder-quobyte-91f74177-c282-49e7-9822-b12cb9022918" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf72b13-4337-4b6c-8492-9b39dedc7702]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:04:44 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 Jul 19 13:04:44 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:04:44 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918" returned: 0 in 0.478s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:04:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:04:44 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918 Jul 19 13:04:44 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:04:45 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91f74177-c282-49e7-9822-b12cb9022918" returned: 0 in 0.302s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Lock "cinder-quobyte-91f74177-c282-49e7-9822-b12cb9022918" released by "delete_volume" :: held 0.845s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Created reservations ['cb5fd657-edc7-4895-bfb9-7071f0209cf4', '9d89922f-255b-4e42-ada7-7710ff126e2c', 'd2c942d7-80f9-402c-b3d8-2b348f67e1cf', 'fd760a3b-0770-4270-97c4-6b30f2c4c41c'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:04:45 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:04:45 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:04:45 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.336s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:04:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Deleted volume successfully. Jul 19 13:04:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2cf4747b-b12b-40ee-afbd-d585eea543ec tempest-DeleteServersTestJSON-1060722982 None] Lock "cinder-91f74177-c282-49e7-9822-b12cb9022918-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:04:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-19cfa878-eb95-4e3c-85d8-c72ea865adda req-bc6b1760-88f0-427c-a106-4a3fed9afbf9 tempest-ServerActionsTestOtherA-354257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-19cfa878-eb95-4e3c-85d8-c72ea865adda req-bc6b1760-88f0-427c-a106-4a3fed9afbf9 tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-19cfa878-eb95-4e3c-85d8-c72ea865adda req-bc6b1760-88f0-427c-a106-4a3fed9afbf9 tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-19cfa878-eb95-4e3c-85d8-c72ea865adda req-bc6b1760-88f0-427c-a106-4a3fed9afbf9 tempest-ServerActionsTestOtherA-354257058 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3058330-630a-4644-bcdd-59834ac60670', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:04:48 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-19cfa878-eb95-4e3c-85d8-c72ea865adda req-bc6b1760-88f0-427c-a106-4a3fed9afbf9 tempest-ServerActionsTestOtherA-354257058 None] attachment_update completed successfully. Jul 19 13:04:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-70f216eb-ef49-40c1-93fe-15bce36679c3 req-3f3a088a-0fe5-473d-8e00-1f3700171110 tempest-ServerActionsTestOtherA-354257058 None] Terminate volume connection completed successfully. Jul 19 13:04:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-70f216eb-ef49-40c1-93fe-15bce36679c3 req-3f3a088a-0fe5-473d-8e00-1f3700171110 tempest-ServerActionsTestOtherA-354257058 None] Deleting attachment e3058330-630a-4644-bcdd-59834ac60670. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:04:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-70f216eb-ef49-40c1-93fe-15bce36679c3 req-ef150403-9635-403a-bc5b-20fc1b48a217 tempest-ServerActionsTestOtherA-354257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:04:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-70f216eb-ef49-40c1-93fe-15bce36679c3 req-ef150403-9635-403a-bc5b-20fc1b48a217 tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:04:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-70f216eb-ef49-40c1-93fe-15bce36679c3 req-ef150403-9635-403a-bc5b-20fc1b48a217 tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:04:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-70f216eb-ef49-40c1-93fe-15bce36679c3 req-ef150403-9635-403a-bc5b-20fc1b48a217 tempest-ServerActionsTestOtherA-354257058 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aff7c7d0-be4e-4417-b23b-cf9d4c8309df', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:04:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-70f216eb-ef49-40c1-93fe-15bce36679c3 req-ef150403-9635-403a-bc5b-20fc1b48a217 tempest-ServerActionsTestOtherA-354257058 None] attachment_update completed successfully. Jul 19 13:05:05 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=30,cinder:UPDATE=16,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:05:05 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=15,cinder:SELECT=28,cinder:INSERT=4 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Flow 'volume_create_manager' (3716fe48-f54d-4afc-a176-c2fb6ca7b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c9905-45ea-451a-abf1-3f07ce772173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c9905-45ea-451a-abf1-3f07ce772173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-120934674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f99aab-5b4a-43cb-aff0-1f54f5f577fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d742f748f29c4cbfb29aae6477d5247a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:25Z,use_quota=True,user_id='d95a4df1a87b4f97911c4cc03907a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c064088-8072-4542-a182-30e9fc15cbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c064088-8072-4542-a182-30e9fc15cbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee4b847-8304-4710-8a3d-91216aaaee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee4b847-8304-4710-8a3d-91216aaaee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f99aab-5b4a-43cb-aff0-1f54f5f577fa', 'volume_name': 'volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dd6a2e-5353-4e46-9acf-0221f25ec481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dd6a2e-5353-4e46-9acf-0221f25ec481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526dd978-58d9-4b4f-b09a-f254bffc500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:24 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Volume 44f99aab-5b4a-43cb-aff0-1f54f5f577fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa', 'volume_size': 1} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-120934674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f99aab-5b4a-43cb-aff0-1f54f5f577fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d742f748f29c4cbfb29aae6477d5247a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:25Z,use_quota=True,user_id='d95a4df1a87b4f97911c4cc03907a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Creating volume 44f99aab-5b4a-43cb-aff0-1f54f5f577fa {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:05:24 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:05:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:24 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa 1073741824 Jul 19 13:05:24 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:25 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa 1073741824" returned: 0 in 0.466s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:25 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa Jul 19 13:05:25 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:25 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa" returned: 0 in 0.259s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526dd978-58d9-4b4f-b09a-f254bffc500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4bab81-3b92-4127-912e-1992eccabd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Volume volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa (44f99aab-5b4a-43cb-aff0-1f54f5f577fa): created successfully Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4bab81-3b92-4127-912e-1992eccabd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Flow 'volume_create_manager' (3716fe48-f54d-4afc-a176-c2fb6ca7b891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-72b4e531-becb-4c37-b34a-baf668ed5a30 tempest-ServersNegativeTestJSON-1938165580 None] Created volume successfully. Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Flow 'volume_create_manager' (3668c4d9-2846-4185-8955-0cf8bd16e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c9ce6b-4184-4ca2-affd-c060f2f3bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c9ce6b-4184-4ca2-affd-c060f2f3bb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2004023633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0f124a-7273-4c03-bd21-62e9cf669a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d742f748f29c4cbfb29aae6477d5247a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:29Z,use_quota=True,user_id='d95a4df1a87b4f97911c4cc03907a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b590d4f-9c24-4566-bed8-eb09cd206878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b590d4f-9c24-4566-bed8-eb09cd206878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f79fbed-b4f4-4daa-b9ec-f0a258e98c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f79fbed-b4f4-4daa-b9ec-f0a258e98c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0f124a-7273-4c03-bd21-62e9cf669a05', 'volume_name': 'volume-cc0f124a-7273-4c03-bd21-62e9cf669a05', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181a9896-e275-4112-a37b-c729dd2aeaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181a9896-e275-4112-a37b-c729dd2aeaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f91383-9409-441d-8877-274ef86009da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:28 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Volume cc0f124a-7273-4c03-bd21-62e9cf669a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0f124a-7273-4c03-bd21-62e9cf669a05', 'volume_size': 1} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2004023633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0f124a-7273-4c03-bd21-62e9cf669a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d742f748f29c4cbfb29aae6477d5247a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:29Z,use_quota=True,user_id='d95a4df1a87b4f97911c4cc03907a6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Creating volume cc0f124a-7273-4c03-bd21-62e9cf669a05 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:05:28 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:05:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:28 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 1073741824 Jul 19 13:05:28 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:29 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 1073741824" returned: 0 in 0.656s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:29 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 Jul 19 13:05:29 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:29 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05" returned: 0 in 0.364s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:05:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f91383-9409-441d-8877-274ef86009da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0f124a-7273-4c03-bd21-62e9cf669a05', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ded4c43-20b5-425e-b6d9-e15e098b4349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Volume volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 (cc0f124a-7273-4c03-bd21-62e9cf669a05): created successfully Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ded4c43-20b5-425e-b6d9-e15e098b4349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Flow 'volume_create_manager' (3668c4d9-2846-4185-8955-0cf8bd16e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b6a41b36-7782-4f87-a6ec-b9766dbe24c6 tempest-ServersNegativeTestJSON-1938165580 None] Created volume successfully. Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Flow 'volume_create_manager' (b517d238-797e-4b9f-b2cb-f10ce642332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d27ec30-cec4-4c41-9552-fd3a28f27613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d27ec30-cec4-4c41-9552-fd3a28f27613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-546411286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56ea8e7-75cc-46d8-a370-777dfd9ba3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd42b1724454873a89d17223344ffcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:30Z,use_quota=True,user_id='612bf06a074944cab82dbb0b8ecac4a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446b59e5-2320-4239-a679-9f3095cef895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446b59e5-2320-4239-a679-9f3095cef895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fade7b3-ddd6-4b08-b862-e51cf06f86c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fade7b3-ddd6-4b08-b862-e51cf06f86c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56ea8e7-75cc-46d8-a370-777dfd9ba3b3', 'volume_name': 'volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fe0ffe-24e9-4230-b5ae-2b6d5ad04160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fe0ffe-24e9-4230-b5ae-2b6d5ad04160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7959b246-e4b5-4943-a035-492265160feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Volume b56ea8e7-75cc-46d8-a370-777dfd9ba3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3', 'volume_size': 1} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-546411286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56ea8e7-75cc-46d8-a370-777dfd9ba3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd42b1724454873a89d17223344ffcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:30Z,use_quota=True,user_id='612bf06a074944cab82dbb0b8ecac4a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Creating volume b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:05:30 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:30 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 1073741824 Jul 19 13:05:30 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:30 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 1073741824" returned: 0 in 0.474s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:30 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 Jul 19 13:05:30 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:31 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3" returned: 0 in 0.398s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7959b246-e4b5-4943-a035-492265160feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a58975-6946-44ff-8c90-d8dc5da8e261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:31 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Volume volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 (b56ea8e7-75cc-46d8-a370-777dfd9ba3b3): created successfully Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a58975-6946-44ff-8c90-d8dc5da8e261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Flow 'volume_create_manager' (b517d238-797e-4b9f-b2cb-f10ce642332a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:31 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-487d3d77-162c-4c43-8ac7-05956d00ace3 tempest-AttachVolumeShelveTestJSON-249516120 None] Created volume successfully. Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "cinder-cc0f124a-7273-4c03-bd21-62e9cf669a05-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-cc0f124a-7273-4c03-bd21-62e9cf669a05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "cinder-quobyte-cc0f124a-7273-4c03-bd21-62e9cf669a05" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-quobyte-cc0f124a-7273-4c03-bd21-62e9cf669a05" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bd2ae4-4b0d-4c56-82ba-2449e9252734]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:05:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:31 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 Jul 19 13:05:31 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:32 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05" returned: 0 in 0.435s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:32 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05 Jul 19 13:05:32 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-36488c07-f1c3-4bac-be83-da281ea678aa req-01ddda53-6f98-430b-b514-ea2f2f5b79f1 tempest-ServerActionsTestOtherA-354257058 None] Terminate volume connection completed successfully. Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-36488c07-f1c3-4bac-be83-da281ea678aa req-01ddda53-6f98-430b-b514-ea2f2f5b79f1 tempest-ServerActionsTestOtherA-354257058 None] Deleting attachment aff7c7d0-be4e-4417-b23b-cf9d4c8309df. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:05:32 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cc0f124a-7273-4c03-bd21-62e9cf669a05" returned: 0 in 0.304s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-quobyte-cc0f124a-7273-4c03-bd21-62e9cf669a05" released by "delete_volume" :: held 0.787s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Created reservations ['55bd08cb-bb9a-42b2-9954-d4b41523a5a4', 'd6234c29-635c-46be-9919-b774f8925c45', '436c3364-4787-4c67-a839-9671e1eec52c', '31522a40-8d66-4d87-bfc9-d646f76f8281'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:32 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:05:32 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "cinder-44f99aab-5b4a-43cb-aff0-1f54f5f577fa-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-44f99aab-5b4a-43cb-aff0-1f54f5f577fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "cinder-quobyte-44f99aab-5b4a-43cb-aff0-1f54f5f577fa" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-quobyte-44f99aab-5b4a-43cb-aff0-1f54f5f577fa" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[060400a3-ad10-441d-b70c-e563f94196e9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:32 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.330s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:05:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Deleted volume successfully. Jul 19 13:05:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ee53597-3840-41e1-928e-a836777d7215 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-cc0f124a-7273-4c03-bd21-62e9cf669a05-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:33 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa Jul 19 13:05:33 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Flow 'volume_create_manager' (7af1aaae-4ea1-46a4-82de-0234584b2769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3434b5-f110-4bc5-b60a-271b998fed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:33 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa" returned: 0 in 0.576s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3434b5-f110-4bc5-b60a-271b998fed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-370350412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8afc746ef841609e6dad093cad87ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:33Z,use_quota=True,user_id='cf28a472303740aaafc235e8dc7c1b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fa188a-8947-4330-8e39-00669b8b9f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:33 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa Jul 19 13:05:33 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fa188a-8947-4330-8e39-00669b8b9f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0637acfb-9152-4e5e-9839-00534caaeea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0637acfb-9152-4e5e-9839-00534caaeea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd', 'volume_name': 'volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c73b07-cbe0-48df-a48b-c5b2a12de438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c73b07-cbe0-48df-a48b-c5b2a12de438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0789bb9-6549-4b9b-94c4-d7b001a9237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:33 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Volume 1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd', 'volume_size': 1} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-370350412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8afc746ef841609e6dad093cad87ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:33Z,use_quota=True,user_id='cf28a472303740aaafc235e8dc7c1b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Creating volume 1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:05:33 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:33 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd 1073741824 Jul 19 13:05:33 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:33 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-44f99aab-5b4a-43cb-aff0-1f54f5f577fa" returned: 0 in 0.394s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-quobyte-44f99aab-5b4a-43cb-aff0-1f54f5f577fa" released by "delete_volume" :: held 1.034s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:33 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Created reservations ['dc2e542e-9f31-46ed-8d9e-a2abb5372ca1', 'c83d1d62-a363-41d6-abfa-e3985aea9060', 'b4d74fc3-6367-4273-81ad-76609f60186d', 'a40ed8b5-9177-4443-9356-69f21a0bef69'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:34 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:05:34 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:34 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd 1073741824" returned: 0 in 0.772s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:34 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd Jul 19 13:05:34 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:34 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.504s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:05:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Deleted volume successfully. Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-19f6ca51-4b7f-4150-bc6e-c2a15d491c78 tempest-ServersNegativeTestJSON-1938165580 None] Lock "cinder-44f99aab-5b4a-43cb-aff0-1f54f5f577fa-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:34 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd" returned: 0 in 0.353s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0789bb9-6549-4b9b-94c4-d7b001a9237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1344ff32-2f6a-4dc4-90c0-d9e489885694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:34 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Volume volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd (1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd): created successfully Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1344ff32-2f6a-4dc4-90c0-d9e489885694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Flow 'volume_create_manager' (7af1aaae-4ea1-46a4-82de-0234584b2769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-686c4ef7-0e6a-4587-9fbb-2f0079da2cda tempest-TaggedAttachmentsTest-2091064195 None] Created volume successfully. Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Acquiring lock "cinder-584caa47-0a8c-4d62-9cf2-fbc3d9faa963-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Lock "cinder-584caa47-0a8c-4d62-9cf2-fbc3d9faa963-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Acquiring lock "cinder-quobyte-584caa47-0a8c-4d62-9cf2-fbc3d9faa963" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Lock "cinder-quobyte-584caa47-0a8c-4d62-9cf2-fbc3d9faa963" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b279766-28e7-43b5-85df-70ba317dc027]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:39 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 Jul 19 13:05:39 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:39 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963" returned: 0 in 0.473s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:39 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963 Jul 19 13:05:39 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:40 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-584caa47-0a8c-4d62-9cf2-fbc3d9faa963" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Lock "cinder-quobyte-584caa47-0a8c-4d62-9cf2-fbc3d9faa963" released by "delete_volume" :: held 0.812s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Created reservations ['521b7fed-f4c5-4fa9-bba2-63960ecef023', '93e7de7d-d20b-4076-9539-42b9a4352452', 'ba97ed96-c143-415a-8e39-c8144c1953d7', 'e2a478a4-adde-4b4f-be32-4088a0c7a927'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:40 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:05:40 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:40 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.405s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:05:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Deleted volume successfully. Jul 19 13:05:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e3255ff1-c0e1-4ff7-b67c-f95cc9986d4e tempest-ServerActionsTestOtherA-354257058 None] Lock "cinder-584caa47-0a8c-4d62-9cf2-fbc3d9faa963-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:42 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:05:42 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:42 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.414s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:05:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-f5abce94-85fa-461d-b453-df385060dd51 req-72c5e553-ffa6-46a8-990b-398db4d00c62 tempest-AttachVolumeShelveTestJSON-249516120 None] No connector for attachment fda5e373-92e6-4574-9e5c-0118cea58179; skipping storage backend terminate_connection call. {{(pid=87305) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 19 13:05:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-f5abce94-85fa-461d-b453-df385060dd51 req-72c5e553-ffa6-46a8-990b-398db4d00c62 tempest-AttachVolumeShelveTestJSON-249516120 None] Deleting attachment fda5e373-92e6-4574-9e5c-0118cea58179. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Flow 'volume_create_manager' (977175be-0ef3-4a16-80f9-ac67941b370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881376d7-3028-4252-9325-afafac4d6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881376d7-3028-4252-9325-afafac4d6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1601129468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe70e0cbb0f4650a3649e6d8c0192d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:51Z,use_quota=True,user_id='edde0bb57a6b40f1abb7db659dfe3446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66ff459-ee70-4f65-9cbc-5604e423ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66ff459-ee70-4f65-9cbc-5604e423ca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d1787d-634c-4b6e-846d-9c3734a6ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d1787d-634c-4b6e-846d-9c3734a6ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76', 'volume_name': 'volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad274852-fa11-483a-8f32-aa1e007f3465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad274852-fa11-483a-8f32-aa1e007f3465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fe3f52-c64e-4ff3-8508-5ee5d33f74eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:50 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Volume a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76', 'volume_size': 1} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1601129468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe70e0cbb0f4650a3649e6d8c0192d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:05:51Z,use_quota=True,user_id='edde0bb57a6b40f1abb7db659dfe3446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Creating volume a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:05:50 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:05:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:50 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 1073741824 Jul 19 13:05:50 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:51 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 1073741824" returned: 0 in 0.590s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:51 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 Jul 19 13:05:51 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:51 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" returned: 0 in 0.366s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:05:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fe3f52-c64e-4ff3-8508-5ee5d33f74eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82678646-b95d-4bcb-a1fe-216bc43c05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:05:52 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Volume volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 (a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76): created successfully Jul 19 13:05:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82678646-b95d-4bcb-a1fe-216bc43c05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:05:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Flow 'volume_create_manager' (977175be-0ef3-4a16-80f9-ac67941b370a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:05:52 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-dabe664a-efca-4237-92c3-55d1e1b5157c req-285ce069-5baa-4c80-93c6-6b0589753bc7 tempest-VolumesSnapshotsTestJSON-2065594058 None] Created volume successfully. Jul 19 13:05:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:05:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:05:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Creating offline snapshot 0aba4cf6-e4de-49fb-814f-edd3dbd02eae of volume a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:05:53 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f6238c-6d28-4e6a-93d7-90318ebdf5e8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:05:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:53 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 Jul 19 13:05:53 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:54 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" returned: 0 in 0.553s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:54 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae 1G Jul 19 13:05:54 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:54 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae 1G" returned: 0 in 0.630s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:54 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae Jul 19 13:05:54 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:55 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae" returned: 0 in 0.586s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:55 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae is being set with open permissions: ugo+rw Jul 19 13:05:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:55 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae Jul 19 13:05:55 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:55 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:55 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.info Jul 19 13:05:55 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:56 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.info" returned: 0 in 0.536s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:56 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.info is being set with open permissions: ugo+rw Jul 19 13:05:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:56 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.info Jul 19 13:05:56 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:56 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.info" returned: 0 in 0.526s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.345s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:05:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-5a1ac9cd-9a02-4d86-a447-aa43b3bf4e68 req-bb304147-89c1-4332-b675-b3ca6fc7ff6d tempest-VolumesSnapshotsTestJSON-2065594058 None] Create snapshot completed successfully Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "cinder-0aba4cf6-e4de-49fb-814f-edd3dbd02eae-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-0aba4cf6-e4de-49fb-814f-edd3dbd02eae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "cinder-quobyte-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-quobyte-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "cinder-quobyte-0aba4cf6-e4de-49fb-814f-edd3dbd02eae" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-quobyte-0aba4cf6-e4de-49fb-814f-edd3dbd02eae" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Deleting offline snapshot 0aba4cf6-e4de-49fb-814f-edd3dbd02eae of volume a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] snapshot_file for this snap is: volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91c4e1f-b951-4cb1-a77d-1c1346f91ab8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:05:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:57 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae Jul 19 13:05:57 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:58 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae" returned: 0 in 0.563s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:05:58 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73fc72e-e4c8-41e9-9c96-5c0f6cf3033c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:05:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:58 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 Jul 19 13:05:58 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:58 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" returned: 0 in 0.607s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:58 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae Jul 19 13:05:58 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:59 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae" returned: 0 in 0.458s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:05:59 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae Jul 19 13:05:59 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:05:59 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Jul 19 13:05:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76.0aba4cf6-e4de-49fb-814f-edd3dbd02eae" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:05:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-quobyte-0aba4cf6-e4de-49fb-814f-edd3dbd02eae" released by "_delete_snapshot" :: held 2.159s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-quobyte-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" released by "delete_snapshot" :: held 2.205s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:05:59 devstack cinder-volume[87305]: WARNING cinder.quota [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:05:59 devstack cinder-volume[87305]: DEBUG cinder.quota [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Created reservations ['2202761d-2ebe-4294-ace9-476c64fbbda3', 'cd5f0b64-b039-4ff1-86ff-a70816f6fabd', '0c50fa61-a144-4bf8-a312-ac43945129ec', '09d6d4a6-cdc3-4fb6-99a1-d2a3bfe8fdb4'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Delete snapshot completed successfully. Jul 19 13:06:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-c90737fe-629a-4151-8dd8-17d23ab43535 req-7f35cc4b-931c-4de4-8b11-e5982c59e380 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-0aba4cf6-e4de-49fb-814f-edd3dbd02eae-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "cinder-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "cinder-quobyte-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-quobyte-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" acquired by "delete_volume" :: waited 0.056s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3caab4b-dfc1-4dcd-9711-c0e9f495a70c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:01 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 Jul 19 13:06:01 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:01 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" returned: 0 in 0.428s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:01 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76 Jul 19 13:06:01 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:02 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" returned: 0 in 0.307s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-quobyte-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76" released by "delete_volume" :: held 0.805s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG cinder.quota [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Created reservations ['60654b38-ed48-4823-96b6-af4ab2569b90', 'e6534911-b099-4ea4-b3a0-bc5aed1f2816', '5f01f6df-db18-4144-8bfe-2695a297c002', '6c667c76-2f49-4368-8287-11cdd89a4645'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:02 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:06:02 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:02 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.345s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG cinder.manager [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:06:02 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Deleted volume successfully. Jul 19 13:06:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-d73e312e-69d2-4037-ac47-056f008fc440 req-b8b0f68f-7f47-4a7e-8a92-f4e19f883809 tempest-VolumesSnapshotsTestJSON-2065594058 None] Lock "cinder-a2a98f0d-b064-4cad-90b5-5ee3ea7e2f76-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e2d32da5-2c26-47c7-a13e-21577829aaa4 tempest-GroupSnapshotsV319Test-873975164 None] Group tempest-GroupSnapshotsV319Test-Group-657792120: creating Jul 19 13:06:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e2d32da5-2c26-47c7-a13e-21577829aaa4 tempest-GroupSnapshotsV319Test-873975164 None] Group tempest-GroupSnapshotsV319Test-Group-657792120: created successfully Jul 19 13:06:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e2d32da5-2c26-47c7-a13e-21577829aaa4 tempest-GroupSnapshotsV319Test-873975164 None] Create group completed successfully. Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Flow 'volume_create_manager' (0445471a-549c-4896-8173-e8e47fa0a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74076940-a9d9-4510-8fe4-8e7e05a9f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74076940-a9d9-4510-8fe4-8e7e05a9f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-799983662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ba2b2ca-ac43-42be-b5b1-2137df403bdd,host='devstack@QuobyteHD#QuobyteHD',id=bf626fd0-af43-40fa-83dc-7760ce0206ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6680d3e1256741909f20bdeb3063b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:06:11Z,use_quota=True,user_id='b19ab452727049679a780c7dd86be25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84226a45-1a8d-49d1-aeb6-885a808ad36d),volume_type_id=84226a45-1a8d-49d1-aeb6-885a808ad36d)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba13bca7-433e-4b0e-b650-009294e9b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba13bca7-433e-4b0e-b650-009294e9b224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e57d86-c9e9-4014-9caf-dc48719b9d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e57d86-c9e9-4014-9caf-dc48719b9d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf626fd0-af43-40fa-83dc-7760ce0206ba', 'volume_name': 'volume-bf626fd0-af43-40fa-83dc-7760ce0206ba', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdda1de-c577-400b-95ab-4bf0ede41762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdda1de-c577-400b-95ab-4bf0ede41762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85505505-3f61-42da-bb01-62a52ee06270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Volume bf626fd0-af43-40fa-83dc-7760ce0206ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf626fd0-af43-40fa-83dc-7760ce0206ba', 'volume_size': 1} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ba2b2ca-ac43-42be-b5b1-2137df403bdd,created_at=2026-07-19T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-799983662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ba2b2ca-ac43-42be-b5b1-2137df403bdd,host='devstack@QuobyteHD#QuobyteHD',id=bf626fd0-af43-40fa-83dc-7760ce0206ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6680d3e1256741909f20bdeb3063b5ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:06:11Z,use_quota=True,user_id='b19ab452727049679a780c7dd86be25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84226a45-1a8d-49d1-aeb6-885a808ad36d),volume_type_id=84226a45-1a8d-49d1-aeb6-885a808ad36d)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Creating volume bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:06:10 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:06:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:10 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba 1073741824 Jul 19 13:06:10 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:11 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba 1073741824" returned: 0 in 0.605s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:11 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba Jul 19 13:06:11 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:11 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba" returned: 0 in 0.271s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85505505-3f61-42da-bb01-62a52ee06270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf626fd0-af43-40fa-83dc-7760ce0206ba', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c845ebf-f3ab-4203-a221-9d760790c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Volume volume-bf626fd0-af43-40fa-83dc-7760ce0206ba (bf626fd0-af43-40fa-83dc-7760ce0206ba): created successfully Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c845ebf-f3ab-4203-a221-9d760790c737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Flow 'volume_create_manager' (0445471a-549c-4896-8173-e8e47fa0a6af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:06:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5792a7f5-7e6d-4de8-ba5d-b8a86d77d904 tempest-GroupSnapshotsV319Test-873975164 None] Created volume successfully. Jul 19 13:06:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] GroupSnapshot 71464bdb-6e67-458a-a024-df0330598f5b: creating. Jul 19 13:06:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Group snapshot 71464bdb-6e67-458a-a024-df0330598f5b: creating. {{(pid=87305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 13:06:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Creating offline snapshot beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 of volume bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:06:12 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07050a2-e0d2-4a2c-935f-9d271db8b6b3]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:12 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba Jul 19 13:06:12 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:13 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba" returned: 0 in 0.406s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:13 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 1G Jul 19 13:06:13 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:13 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 1G" returned: 0 in 0.475s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf626fd0-af43-40fa-83dc-7760ce0206ba -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:13 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf626fd0-af43-40fa-83dc-7760ce0206ba -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 Jul 19 13:06:13 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:13 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf626fd0-af43-40fa-83dc-7760ce0206ba -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" returned: 0 in 0.353s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:13 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:06:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:13 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 Jul 19 13:06:13 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:14 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" returned: 0 in 0.261s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:14 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.info Jul 19 13:06:14 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:14 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.info" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:14 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:06:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:14 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.info Jul 19 13:06:14 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:14 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.info" returned: 0 in 0.268s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-99fd5e2d-be6f-4164-b3ed-b0019ce394a4 tempest-GroupSnapshotsV319Test-873975164 None] group_snapshot 71464bdb-6e67-458a-a024-df0330598f5b: created successfully Jul 19 13:06:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] group_snapshot 71464bdb-6e67-458a-a024-df0330598f5b: deleting Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=65,cinder:DELETE=6,cinder:SELECT=50,cinder:INSERT=14 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=53,cinder:INSERT=14,cinder:UPDATE=56,cinder:DELETE=5 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] group_snapshot 71464bdb-6e67-458a-a024-df0330598f5b: deleting {{(pid=87305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Acquiring lock "cinder-quobyte-bf626fd0-af43-40fa-83dc-7760ce0206ba" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Lock "cinder-quobyte-bf626fd0-af43-40fa-83dc-7760ce0206ba" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Acquiring lock "cinder-quobyte-beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Lock "cinder-quobyte-beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Deleting offline snapshot beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 of volume bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] snapshot_file for this snap is: volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7474fb9a-c26c-46e0-a894-135590d56a84]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:16 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 Jul 19 13:06:16 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:17 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" returned: 0 in 0.604s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf626fd0-af43-40fa-83dc-7760ce0206ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:06:17 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f453d922-c321-45ea-9196-de25b7283a6a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:17 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba Jul 19 13:06:17 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:17 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba" returned: 0 in 0.522s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:17 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 Jul 19 13:06:17 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:18 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" returned: 0 in 0.462s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:18 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442 Jul 19 13:06:18 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:18 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba.beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" returned: 0 in 0.281s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Lock "cinder-quobyte-beda9bb5-2d3d-47e3-9f5a-4d33cbe90442" released by "_delete_snapshot" :: held 2.091s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Lock "cinder-quobyte-bf626fd0-af43-40fa-83dc-7760ce0206ba" released by "delete_snapshot" :: held 2.160s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:18 devstack cinder-volume[87305]: WARNING cinder.quota [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2090638627 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2090638627, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:06:18 devstack cinder-volume[87305]: WARNING cinder.quota [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2090638627 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2090638627, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:06:18 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] Created reservations ['942eccc0-b820-45dd-a23c-db76d4e874b1', '89499af3-eea0-4b4f-8492-44534f3cd670', '2a689948-d0a2-450b-b673-84697465601e', '5547b2ce-2aa2-40a4-ae40-e48c20aca385'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d15a356e-66b5-4d25-8c5a-06b6d8f7b669 tempest-GroupSnapshotsV319Test-873975164 None] group_snapshot 71464bdb-6e67-458a-a024-df0330598f5b: deleted successfully Jul 19 13:06:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Acquiring lock "cinder-quobyte-bf626fd0-af43-40fa-83dc-7760ce0206ba" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Lock "cinder-quobyte-bf626fd0-af43-40fa-83dc-7760ce0206ba" acquired by "delete_volume" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d400f24-bc11-4869-9f55-7fd5e14b1c01]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:20 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba Jul 19 13:06:20 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:20 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba" returned: 0 in 0.518s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:20 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba Jul 19 13:06:20 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:20 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bf626fd0-af43-40fa-83dc-7760ce0206ba" returned: 0 in 0.315s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Lock "cinder-quobyte-bf626fd0-af43-40fa-83dc-7760ce0206ba" released by "delete_volume" :: held 0.956s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:20 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Created reservations ['feab69a4-0cd4-4633-a92f-9092fac0b953'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:21 devstack cinder-volume[87305]: WARNING cinder.quota [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2090638627 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2090638627, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Created reservations ['c70242b8-8a26-4a9b-bbfd-a64785153785', 'a9fa25ab-d38d-453c-a144-9270d5757a83', 'd4a61c90-4c3f-4187-a946-a7047f4efd74', '88040794-4f5e-4fb1-9437-720e50c03ab2'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:21 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:06:21 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:21 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.386s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:06:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-74bc396c-a50b-4de8-8df0-b26f8e377ccd tempest-GroupSnapshotsV319Test-873975164 None] Delete group completed successfully. Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-d4c87319-80f6-4d26-9016-f4608d7dc249 req-790be2b8-0849-4bba-87ef-28d866e1c7b0 tempest-TaggedAttachmentsTest-2091064195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-d4c87319-80f6-4d26-9016-f4608d7dc249 req-790be2b8-0849-4bba-87ef-28d866e1c7b0 tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-d4c87319-80f6-4d26-9016-f4608d7dc249 req-790be2b8-0849-4bba-87ef-28d866e1c7b0 tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-d4c87319-80f6-4d26-9016-f4608d7dc249 req-790be2b8-0849-4bba-87ef-28d866e1c7b0 tempest-TaggedAttachmentsTest-2091064195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2162649-7271-4285-a205-fd019e92a67f', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:06:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-d4c87319-80f6-4d26-9016-f4608d7dc249 req-790be2b8-0849-4bba-87ef-28d866e1c7b0 tempest-TaggedAttachmentsTest-2091064195 None] attachment_update completed successfully. Jul 19 13:06:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-875edd83-f215-4de3-90c6-41a7ccf97f9a req-b3afa39a-989c-4b3a-93f6-9cab76c01147 tempest-TaggedAttachmentsTest-2091064195 None] Terminate volume connection completed successfully. Jul 19 13:06:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-875edd83-f215-4de3-90c6-41a7ccf97f9a req-b3afa39a-989c-4b3a-93f6-9cab76c01147 tempest-TaggedAttachmentsTest-2091064195 None] Deleting attachment e2162649-7271-4285-a205-fd019e92a67f. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:06:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Acquiring lock "cinder-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "cinder-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Acquiring lock "cinder-quobyte-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "cinder-quobyte-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50972e3-e03a-48c6-9454-e2d837b11ded]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:33 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 Jul 19 13:06:33 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:34 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3" returned: 0 in 0.446s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:34 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3 Jul 19 13:06:34 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:34 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3" returned: 0 in 0.455s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "cinder-quobyte-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3" released by "delete_volume" :: held 0.959s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Created reservations ['2d9e7293-0e2d-4606-9462-20b0ffe10933', 'ca5ce96d-c312-4dd1-8b5a-af1520f14a69', 'cb1f6184-0f96-4aa1-9bb1-ee90b0555383', '0dfb80d7-eb69-4a2b-946a-de3473d243f7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:35 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:06:35 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:35 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:35 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:06:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Deleted volume successfully. Jul 19 13:06:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-39fd6210-2fe6-4a38-adab-5dcc6211640d tempest-AttachVolumeShelveTestJSON-249516120 None] Lock "cinder-b56ea8e7-75cc-46d8-a370-777dfd9ba3b3-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fe741f2a-c858-4b3b-8136-c572ca8cba73 tempest-GroupsV314Test-2124852993 None] Group tempest-GroupsV314Test-Group-1735832225: creating Jul 19 13:06:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fe741f2a-c858-4b3b-8136-c572ca8cba73 tempest-GroupsV314Test-2124852993 None] Group tempest-GroupsV314Test-Group-1735832225: created successfully Jul 19 13:06:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fe741f2a-c858-4b3b-8136-c572ca8cba73 tempest-GroupsV314Test-2124852993 None] Create group completed successfully. Jul 19 13:06:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Acquiring lock "cinder-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Lock "cinder-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Acquiring lock "cinder-quobyte-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Lock "cinder-quobyte-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:38 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3900c3-6bcb-4107-aa7b-35ad03fa5d2c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:39 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd Jul 19 13:06:39 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:39 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd" returned: 0 in 0.372s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:39 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd Jul 19 13:06:39 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:39 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd" returned: 0 in 0.340s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Lock "cinder-quobyte-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd" released by "delete_volume" :: held 0.759s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Created reservations ['63d98802-ea84-4b0e-bf83-a1bf0cd8b96a', '61a3e97d-c6ab-45ad-8364-60fbb14de126', '4fd0db87-7172-4841-9b8f-d2c9052800a2', 'b78cb8ce-a092-4cf2-84a2-1d1a1581fe1b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:39 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:06:39 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Flow 'volume_create_manager' (597b7384-e37a-4b04-9c8e-6729faf1e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071bae81-8804-4b6a-97a7-832a45752f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071bae81-8804-4b6a-97a7-832a45752f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1668003579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e04bba17-6835-42c4-bece-8f2c6f08f939,host='devstack@QuobyteHD#QuobyteHD',id=8c94940c-6ed1-4590-acc3-7bc8f32336a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb6bb86f5842ff9611eabd4c2b2195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:06:40Z,use_quota=True,user_id='46726e5c013d4a8abc60b80de87db5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e681c9e-3656-4443-ae08-04542425518e),volume_type_id=9e681c9e-3656-4443-ae08-04542425518e)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7887c85-798c-4183-ab49-e7253fe2c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7887c85-798c-4183-ab49-e7253fe2c37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94916f34-160e-4dd1-9286-63b687b9b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94916f34-160e-4dd1-9286-63b687b9b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c94940c-6ed1-4590-acc3-7bc8f32336a0', 'volume_name': 'volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb995bc-2bfc-4674-9da3-2fa7dee7cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb995bc-2bfc-4674-9da3-2fa7dee7cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e9554a-2cd7-4067-8efe-c48f7d67bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Volume 8c94940c-6ed1-4590-acc3-7bc8f32336a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0', 'volume_size': 1} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:40 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e04bba17-6835-42c4-bece-8f2c6f08f939,created_at=2026-07-19T11:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1668003579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e04bba17-6835-42c4-bece-8f2c6f08f939,host='devstack@QuobyteHD#QuobyteHD',id=8c94940c-6ed1-4590-acc3-7bc8f32336a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb6bb86f5842ff9611eabd4c2b2195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:06:40Z,use_quota=True,user_id='46726e5c013d4a8abc60b80de87db5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e681c9e-3656-4443-ae08-04542425518e),volume_type_id=9e681c9e-3656-4443-ae08-04542425518e)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Creating volume 8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:06:40 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:06:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Deleted volume successfully. Jul 19 13:06:40 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 1073741824 Jul 19 13:06:40 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c80a88d1-17d5-4852-afc4-17427cf2d13f tempest-TaggedAttachmentsTest-2091064195 None] Lock "cinder-1ef1dc1e-9dc8-4f72-a7a9-1929c0b4babd-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:40 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 1073741824" returned: 0 in 0.524s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:40 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 Jul 19 13:06:40 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:41 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0" returned: 0 in 0.311s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:06:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e9554a-2cd7-4067-8efe-c48f7d67bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba652c53-135f-4ad4-88e2-329c525cdc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Volume volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 (8c94940c-6ed1-4590-acc3-7bc8f32336a0): created successfully Jul 19 13:06:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba652c53-135f-4ad4-88e2-329c525cdc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Flow 'volume_create_manager' (597b7384-e37a-4b04-9c8e-6729faf1e46c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:06:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-583e2aaf-2fcf-447b-9224-1c023359ce40 tempest-GroupsV314Test-2124852993 None] Created volume successfully. Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:42 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Cloning volume 8c94940c-6ed1-4590-acc3-7bc8f32336a0 to volume e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Creating offline snapshot 8fda78b2-ed51-45db-ad19-d341c5e75857 of volume 8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e596293e-45d1-4002-844e-ce98007610ac]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:42 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 Jul 19 13:06:42 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:42 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:06:42 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:42 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0" returned: 0 in 0.474s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:42 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 1G Jul 19 13:06:42 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:42 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 8 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:06:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:06:43 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 1G" returned: 0 in 0.544s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:43 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 Jul 19 13:06:43 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:43 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857" returned: 0 in 0.378s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:43 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:06:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:43 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 Jul 19 13:06:43 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:43 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857" returned: 0 in 0.335s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:43 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.info Jul 19 13:06:43 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:44 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.info" returned: 0 in 0.285s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:44 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:44 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.info Jul 19 13:06:44 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:44 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.info" returned: 0 in 0.322s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Acquiring lock "cinder-quobyte-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] snapshot: 8fda78b2-ed51-45db-ad19-d341c5e75857, volume: e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f601c46f-9c17-4037-afaa-41f64ff9b671]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:44 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 Jul 19 13:06:44 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:44 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857" returned: 0 in 0.395s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:06:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:06:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c287d0-edde-4938-bab4-2bf31a5ab440]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:45 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 Jul 19 13:06:45 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:45 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:45 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:06:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:45 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb Jul 19 13:06:45 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" returned: 0 in 6.640s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7d319c-a40e-477c-9e4a-7ae23636139a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:06:52 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 Jul 19 13:06:52 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Flow 'volume_create_manager' (a590bc58-477f-42b5-9a8d-49bf3f51ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e175ab-a766-45b9-87f6-2a79532f0b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e175ab-a766-45b9-87f6-2a79532f0b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-95209830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33420328-9d87-4114-9701-561c007c48e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7a3e0d0e8440aeb6ec61b9475db3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:06:52Z,use_quota=True,user_id='15897bf333b54af7a099532c7f6c51ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dbc1dc-85fe-438e-878f-29a43cb668e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dbc1dc-85fe-438e-878f-29a43cb668e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6608004-dc67-4f73-88ef-c14c8a606a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6608004-dc67-4f73-88ef-c14c8a606a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33420328-9d87-4114-9701-561c007c48e5', 'volume_name': 'volume-33420328-9d87-4114-9701-561c007c48e5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef22943-bf9c-47d3-87e4-674afd3d706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef22943-bf9c-47d3-87e4-674afd3d706c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b128a87-a21d-4ebb-90a4-570d3f507286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:52 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Volume 33420328-9d87-4114-9701-561c007c48e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33420328-9d87-4114-9701-561c007c48e5', 'volume_size': 1} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:52 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0" returned: 0 in 0.593s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:06:52 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Converted 1024.00 MB image at 154.17 MB/s Jul 19 13:06:52 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:52 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb Jul 19 13:06:52 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:52 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" released by "_copy_volume_from_snapshot" :: held 8.375s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Acquiring lock "cinder-quobyte-8fda78b2-ed51-45db-ad19-d341c5e75857" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-8fda78b2-ed51-45db-ad19-d341c5e75857" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Deleting offline snapshot 8fda78b2-ed51-45db-ad19-d341c5e75857 of volume 8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:06:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] snapshot_file for this snap is: volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:06:53 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a8d956-98c4-4d4d-80b4-8e1029aed333]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:53 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 Jul 19 13:06:53 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:53 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857" returned: 0 in 0.434s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:06:53 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578cccf-df08-4c18-820b-beb3c9a0a59d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:53 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 Jul 19 13:06:53 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:54 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0" returned: 0 in 0.478s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:54 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 Jul 19 13:06:54 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:54 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857" returned: 0 in 0.431s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:54 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857 Jul 19 13:06:54 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:54 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0.8fda78b2-ed51-45db-ad19-d341c5e75857" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-8fda78b2-ed51-45db-ad19-d341c5e75857" released by "_delete_snapshot" :: held 1.811s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.768s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.492s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-95209830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33420328-9d87-4114-9701-561c007c48e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7a3e0d0e8440aeb6ec61b9475db3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:06:52Z,use_quota=True,user_id='15897bf333b54af7a099532c7f6c51ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Creating volume 33420328-9d87-4114-9701-561c007c48e5 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:06:54 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:06:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:54 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 1073741824 Jul 19 13:06:54 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ad6743bc-a786-4205-84ef-828c6877521d tempest-GroupsV314Test-2124852993 None] Create group from source-group-e04bba17-6835-42c4-bece-8f2c6f08f939 completed successfully. Jul 19 13:06:55 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 1073741824" returned: 0 in 0.613s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:55 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 Jul 19 13:06:55 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:55 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5" returned: 0 in 0.303s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b128a87-a21d-4ebb-90a4-570d3f507286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33420328-9d87-4114-9701-561c007c48e5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d8d831-0d53-4ad8-8bbc-5aa7d30016f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:55 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Volume volume-33420328-9d87-4114-9701-561c007c48e5 (33420328-9d87-4114-9701-561c007c48e5): created successfully Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d8d831-0d53-4ad8-8bbc-5aa7d30016f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Flow 'volume_create_manager' (a590bc58-477f-42b5-9a8d-49bf3f51ef74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:06:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b9751da5-a5f4-4f20-99a3-2ded6e8389f0 tempest-AttachVolumeNegativeTest-1076077273 None] Created volume successfully. Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Acquiring lock "cinder-quobyte-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d15886-48d4-4cce-bcbc-2a86cf8ff12d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:56 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb Jul 19 13:06:56 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:56 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" returned: 0 in 0.454s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:56 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb Jul 19 13:06:56 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:56 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" returned: 0 in 0.302s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-e3f29d23-2d5e-4fc6-94ef-dfc7cd7e31eb" released by "delete_volume" :: held 0.815s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Created reservations ['8bceadcc-8809-49fa-a9d7-981b1915bc2c'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:56 devstack cinder-volume[87305]: WARNING cinder.quota [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-944969603 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-944969603, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:06:56 devstack cinder-volume[87305]: WARNING cinder.quota [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-944969603 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-944969603, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:06:56 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Created reservations ['d2d63577-90a4-4f47-a042-6c3f25e7ea4c', '6d3d2196-e2c6-491b-a61c-127b80080cdb', 'f1e466df-ac66-4895-a3c3-ba8736510d7b', '0d298924-1aee-44b0-a371-6bfb81e979a8'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:57 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:06:57 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-8e74ebd2-6184-4a6c-9c48-ea5908b71f7d req-0a89bb53-b3f7-4dff-952f-ea1a0ead57d7 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-8e74ebd2-6184-4a6c-9c48-ea5908b71f7d req-0a89bb53-b3f7-4dff-952f-ea1a0ead57d7 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-8e74ebd2-6184-4a6c-9c48-ea5908b71f7d req-0a89bb53-b3f7-4dff-952f-ea1a0ead57d7 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:57 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.533s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:06:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-06d8254e-6c59-4818-b8e0-3a50836a7b69 tempest-GroupsV314Test-2124852993 None] Delete group completed successfully. Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-8e74ebd2-6184-4a6c-9c48-ea5908b71f7d req-0a89bb53-b3f7-4dff-952f-ea1a0ead57d7 tempest-AttachVolumeNegativeTest-1076077273 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-33420328-9d87-4114-9701-561c007c48e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19ce5d9b-55d0-4913-90af-623eb201f231', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:06:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-8e74ebd2-6184-4a6c-9c48-ea5908b71f7d req-0a89bb53-b3f7-4dff-952f-ea1a0ead57d7 tempest-AttachVolumeNegativeTest-1076077273 None] attachment_update completed successfully. Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Acquiring lock "cinder-quobyte-8c94940c-6ed1-4590-acc3-7bc8f32336a0" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-8c94940c-6ed1-4590-acc3-7bc8f32336a0" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5506c25-feb7-482c-bae8-a2b434379b55]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:06:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:58 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 Jul 19 13:06:58 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:58 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0" returned: 0 in 0.636s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:58 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0 Jul 19 13:06:58 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:58 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8c94940c-6ed1-4590-acc3-7bc8f32336a0" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Lock "cinder-quobyte-8c94940c-6ed1-4590-acc3-7bc8f32336a0" released by "delete_volume" :: held 1.079s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Created reservations ['deb3127f-472c-4299-9690-8c07c000be86'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Created reservations ['21d6ac1a-5f46-4763-b326-1a730e1ba083', 'f6b439e3-b698-457e-a921-a9965c983151', 'e2124c10-a840-41cd-be85-aa9f3c5936cc', 'bd58079d-54ce-48f5-948f-52cb0c17d048'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:59 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:06:59 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:06:59 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.310s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:06:59 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c0cdf7c5-6d3e-4e3f-b788-6211f195d5ad tempest-GroupsV314Test-2124852993 None] Delete group completed successfully. Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Flow 'volume_create_manager' (c7670546-562a-45e3-af9b-da7125c61064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da5ae252-7746-4edf-a540-5fa018550f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da5ae252-7746-4edf-a540-5fa018550f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-155883319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8437e94c-0b79-432d-ad30-2bb34827a51c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='348a47d2891741f6b7b66fdf0a826215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:00Z,use_quota=True,user_id='8765ea18ebd944349f9c478dcb0e63d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e12b78-235e-4229-ad08-d4c179b1d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e12b78-235e-4229-ad08-d4c179b1d139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1940c9-ce50-4d51-b1eb-1bc24ea04f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1940c9-ce50-4d51-b1eb-1bc24ea04f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8437e94c-0b79-432d-ad30-2bb34827a51c', 'volume_name': 'volume-8437e94c-0b79-432d-ad30-2bb34827a51c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45defe79-e00c-42de-b169-8a1556475af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45defe79-e00c-42de-b169-8a1556475af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53298f0-9e92-43ff-b4a3-315e0d16a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:06:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Volume 8437e94c-0b79-432d-ad30-2bb34827a51c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8437e94c-0b79-432d-ad30-2bb34827a51c', 'volume_size': 1} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-155883319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8437e94c-0b79-432d-ad30-2bb34827a51c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='348a47d2891741f6b7b66fdf0a826215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:00Z,use_quota=True,user_id='8765ea18ebd944349f9c478dcb0e63d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Creating volume 8437e94c-0b79-432d-ad30-2bb34827a51c {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:06:59 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:06:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:06:59 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c 1073741824 Jul 19 13:06:59 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:00 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c 1073741824" returned: 0 in 0.567s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:00 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c Jul 19 13:07:00 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:00 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c" returned: 0 in 0.385s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53298f0-9e92-43ff-b4a3-315e0d16a131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8437e94c-0b79-432d-ad30-2bb34827a51c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971ce207-51ea-4674-9cab-162940b743c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:00 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Volume volume-8437e94c-0b79-432d-ad30-2bb34827a51c (8437e94c-0b79-432d-ad30-2bb34827a51c): created successfully Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971ce207-51ea-4674-9cab-162940b743c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Flow 'volume_create_manager' (c7670546-562a-45e3-af9b-da7125c61064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4898d362-053e-4d64-8122-5eea91ac536c tempest-VolumesTestJSON-458446846 None] Created volume successfully. Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Flow 'volume_create_manager' (8c13b654-ab9b-4093-9530-968dd743c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac420e4-7c4c-4f98-bc72-2801df60d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac420e4-7c4c-4f98-bc72-2801df60d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1436824350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49892a6c-f848-4c53-91db-9f300f29454e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='348a47d2891741f6b7b66fdf0a826215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:02Z,use_quota=True,user_id='8765ea18ebd944349f9c478dcb0e63d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d730c2ce-2d50-4e02-96b0-5fe1fec44585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d730c2ce-2d50-4e02-96b0-5fe1fec44585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dbb8ea-8579-41ab-898d-c9512af41103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dbb8ea-8579-41ab-898d-c9512af41103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49892a6c-f848-4c53-91db-9f300f29454e', 'volume_name': 'volume-49892a6c-f848-4c53-91db-9f300f29454e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bc6745-7cd7-488b-8ff7-03dafc9b631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bc6745-7cd7-488b-8ff7-03dafc9b631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bcf1b67-d253-480b-a5c7-498a2334ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:02 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Volume 49892a6c-f848-4c53-91db-9f300f29454e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49892a6c-f848-4c53-91db-9f300f29454e', 'volume_size': 1} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1436824350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49892a6c-f848-4c53-91db-9f300f29454e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='348a47d2891741f6b7b66fdf0a826215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:02Z,use_quota=True,user_id='8765ea18ebd944349f9c478dcb0e63d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Creating volume 49892a6c-f848-4c53-91db-9f300f29454e {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:07:02 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:07:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:02 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e 1073741824 Jul 19 13:07:02 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:03 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e 1073741824" returned: 0 in 0.555s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:03 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e Jul 19 13:07:03 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:03 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e" returned: 0 in 0.308s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bcf1b67-d253-480b-a5c7-498a2334ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49892a6c-f848-4c53-91db-9f300f29454e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceaabe0-7a13-438f-8dce-7ee8c2c535a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:03 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Volume volume-49892a6c-f848-4c53-91db-9f300f29454e (49892a6c-f848-4c53-91db-9f300f29454e): created successfully Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceaabe0-7a13-438f-8dce-7ee8c2c535a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:03 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Flow 'volume_create_manager' (8c13b654-ab9b-4093-9530-968dd743c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-dd8cd231-b724-40b8-8782-f882cd29e59e tempest-VolumesTestJSON-458446846 None] Created volume successfully. Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Flow 'volume_create_manager' (8ee140b4-67da-4ef0-81a8-74dd1b94d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b0452f-f148-47e1-be7f-2829b54bd200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b0452f-f148-47e1-be7f-2829b54bd200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-989326082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcf7775-34e4-4330-8a5c-2f7fe62aed0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='348a47d2891741f6b7b66fdf0a826215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:05Z,use_quota=True,user_id='8765ea18ebd944349f9c478dcb0e63d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc50eef9-6260-4a57-9cc5-19e512ad63b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc50eef9-6260-4a57-9cc5-19e512ad63b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0613b9e0-1cae-4066-8b06-258310bc9e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0613b9e0-1cae-4066-8b06-258310bc9e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcf7775-34e4-4330-8a5c-2f7fe62aed0f', 'volume_name': 'volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d200cf-e328-4cfd-a440-841aef18d767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d200cf-e328-4cfd-a440-841aef18d767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff743bde-c881-4d5e-a910-c6dd94a0e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:05 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Volume 6fcf7775-34e4-4330-8a5c-2f7fe62aed0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f', 'volume_size': 1} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-989326082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcf7775-34e4-4330-8a5c-2f7fe62aed0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='348a47d2891741f6b7b66fdf0a826215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:05Z,use_quota=True,user_id='8765ea18ebd944349f9c478dcb0e63d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Creating volume 6fcf7775-34e4-4330-8a5c-2f7fe62aed0f {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:07:05 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:07:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:05 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f 1073741824 Jul 19 13:07:05 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:06 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f 1073741824" returned: 0 in 0.834s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:06 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f Jul 19 13:07:06 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:06 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f" returned: 0 in 0.344s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:07:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff743bde-c881-4d5e-a910-c6dd94a0e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4d1cfe-f19a-4f25-8a1e-17f9a426a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:06 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Volume volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f (6fcf7775-34e4-4330-8a5c-2f7fe62aed0f): created successfully Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4d1cfe-f19a-4f25-8a1e-17f9a426a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Flow 'volume_create_manager' (8ee140b4-67da-4ef0-81a8-74dd1b94d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:07 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-48f4c9d2-c124-4d1a-bd97-bfaad361eaba tempest-VolumesTestJSON-458446846 None] Created volume successfully. Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Flow 'volume_create_manager' (8637c3b9-3783-4ef1-b81c-ff3cdd42121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39966c1-f45d-4b99-806f-9328bcc02b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39966c1-f45d-4b99-806f-9328bcc02b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1062072756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a00cfe26c7964266a7e565947d823263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:08Z,use_quota=True,user_id='c53a8e6b30c24a8b8f04c14bfda5b781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9079421f-527a-4a9e-9e54-bed749329afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9079421f-527a-4a9e-9e54-bed749329afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b99798e-404a-476c-bd77-f41950fd851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b99798e-404a-476c-bd77-f41950fd851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db', 'volume_name': 'volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1f5320-b215-4160-8095-3852cc8993a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1f5320-b215-4160-8095-3852cc8993a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3e2b49-06de-4190-b38e-8cf1f87f921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:07 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db', 'volume_size': 1} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1062072756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a00cfe26c7964266a7e565947d823263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:08Z,use_quota=True,user_id='c53a8e6b30c24a8b8f04c14bfda5b781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Creating volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:07:07 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:07:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:07 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db 1073741824 Jul 19 13:07:07 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:08 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db 1073741824" returned: 0 in 0.724s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:08 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db Jul 19 13:07:08 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:09 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" returned: 0 in 0.634s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:07:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3e2b49-06de-4190-b38e-8cf1f87f921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c7de48-8c83-4402-8a91-1e96c7187391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:09 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Volume volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db (0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db): created successfully Jul 19 13:07:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c7de48-8c83-4402-8a91-1e96c7187391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Flow 'volume_create_manager' (8637c3b9-3783-4ef1-b81c-ff3cdd42121f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:09 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3d855fc3-8997-49a7-8565-9759bd07af40 tempest-SnapshotsActionsTest-817208483 None] Created volume successfully. Jul 19 13:07:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Creating offline snapshot 439e89e5-2ba1-44a0-b50a-52f5962e0d99 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:07:10 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d4cf1e-f333-4aa0-ac84-2545aa36ae27]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Acquiring lock "cinder-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:10 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db Jul 19 13:07:10 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Lock "cinder-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Acquiring lock "cinder-quobyte-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Lock "cinder-quobyte-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f" acquired by "delete_volume" :: waited 0.053s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd6112-6514-413e-a983-1a1aea465bc9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:11 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f Jul 19 13:07:11 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:11 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" returned: 0 in 1.225s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:12 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 1G Jul 19 13:07:12 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:12 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f" returned: 0 in 1.075s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:12 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f Jul 19 13:07:12 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:12 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f" returned: 0 in 0.425s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Lock "cinder-quobyte-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f" released by "delete_volume" :: held 1.672s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:12 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 1G" returned: 0 in 1.026s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Created reservations ['9a433c04-bb08-41bf-bb1d-9f0aeb9cc10b', '91a44369-911d-4665-9b94-c87bf03017b5', 'fd5291c7-ade4-4281-a1a6-3d9f9a0a681c', '9e20152d-d210-4c7c-90e6-6c56ebfb5ee3'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:13 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:13 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:13 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:07:13 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Acquiring lock "cinder-49892a6c-f848-4c53-91db-9f300f29454e-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Lock "cinder-49892a6c-f848-4c53-91db-9f300f29454e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Acquiring lock "cinder-quobyte-49892a6c-f848-4c53-91db-9f300f29454e" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:13 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Lock "cinder-quobyte-49892a6c-f848-4c53-91db-9f300f29454e" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.786s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:13 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 is being set with open permissions: ugo+rw Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81756592-9c99-4486-b547-2c79f55a5e2c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:13 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:13 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:14 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.706s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:07:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Deleted volume successfully. Jul 19 13:07:14 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e Jul 19 13:07:14 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a22fee21-6129-4e30-b047-731195dc79e9 tempest-VolumesTestJSON-458446846 None] Lock "cinder-6fcf7775-34e4-4330-8a5c-2f7fe62aed0f-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:14 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.591s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:14 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e" returned: 0 in 0.560s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:14 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e Jul 19 13:07:14 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:14 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.info Jul 19 13:07:14 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:14 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-49892a6c-f848-4c53-91db-9f300f29454e" returned: 0 in 0.362s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Lock "cinder-quobyte-49892a6c-f848-4c53-91db-9f300f29454e" released by "delete_volume" :: held 1.074s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:14 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Created reservations ['82852149-c3af-448b-ad6c-4c10fbcafdce', '82031c8f-1e98-40f6-b15b-2d927b644398', '4892656b-bd01-4e4e-a65b-39ac56d742f7', 'dd6a3319-a4b5-4d43-ad4b-a10b8115073b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:15 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.info" returned: 0 in 0.582s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:15 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.info is being set with open permissions: ugo+rw Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:15 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.info Jul 19 13:07:15 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:15 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:07:15 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:15 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.info" returned: 0 in 0.452s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.883s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-43ade566-e3a2-4409-9f54-d948d689a6a2 tempest-SnapshotsActionsTest-817208483 None] Create snapshot completed successfully Jul 19 13:07:15 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.530s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:07:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Deleted volume successfully. Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e60a733d-f8ea-46e4-a7e6-48cd228aa3a0 tempest-VolumesTestJSON-458446846 None] Lock "cinder-49892a6c-f848-4c53-91db-9f300f29454e-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Acquiring lock "cinder-8437e94c-0b79-432d-ad30-2bb34827a51c-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Lock "cinder-8437e94c-0b79-432d-ad30-2bb34827a51c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Acquiring lock "cinder-quobyte-8437e94c-0b79-432d-ad30-2bb34827a51c" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Lock "cinder-quobyte-8437e94c-0b79-432d-ad30-2bb34827a51c" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[584da38e-8dc0-4337-b710-de4185daadcf]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:16 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c Jul 19 13:07:16 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:16 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c" returned: 0 in 0.749s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:16 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c Jul 19 13:07:17 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=91,cinder:INSERT=20,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=90,cinder:UPDATE=107,cinder:INSERT=24,cinder:DELETE=3 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Creating offline snapshot cb479e95-2a81-49a1-8a84-0e4a7958f6f5 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40d831-7ff1-4685-81f2-b54a9dbea483]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:17 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8437e94c-0b79-432d-ad30-2bb34827a51c" returned: 0 in 0.466s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Lock "cinder-quobyte-8437e94c-0b79-432d-ad30-2bb34827a51c" released by "delete_volume" :: held 1.309s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:17 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:17 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Created reservations ['0fadad97-ceac-4af5-8e73-4f737587dd43', '42f9ae52-d59a-4753-8879-455276623058', 'ff882f96-b32a-47a1-b157-2604f8d5c924', '950b59c0-c8db-4bfb-a114-c30b447b6a56'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:17 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:07:17 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:18 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.850s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:18 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 1G Jul 19 13:07:18 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:18 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.661s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:07:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Deleted volume successfully. Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-40ae6613-dd5b-4bc0-a533-e70a57a32588 tempest-VolumesTestJSON-458446846 None] Lock "cinder-8437e94c-0b79-432d-ad30-2bb34827a51c-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:18 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 1G" returned: 0 in 0.794s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:18 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 Jul 19 13:07:18 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:19 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5" returned: 0 in 0.578s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:19 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 is being set with open permissions: ugo+rw Jul 19 13:07:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:19 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 Jul 19 13:07:19 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:19 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.767s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:19 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9d07e77d-06bd-48ed-9060-c5b4bbd1f69b tempest-SnapshotsActionsTest-817208483 None] Create snapshot completed successfully Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-cb479e95-2a81-49a1-8a84-0e4a7958f6f5-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-cb479e95-2a81-49a1-8a84-0e4a7958f6f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-cb479e95-2a81-49a1-8a84-0e4a7958f6f5" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-cb479e95-2a81-49a1-8a84-0e4a7958f6f5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Deleting offline snapshot cb479e95-2a81-49a1-8a84-0e4a7958f6f5 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] snapshot_file for this snap is: volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[55958312-fe2c-4f1b-b13b-ed125221ac08]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:20 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 Jul 19 13:07:20 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:21 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5" returned: 0 in 0.426s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc139cd3-0ffd-4fe6-a23e-b72028418469]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:21 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:21 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:21 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.439s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:21 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 Jul 19 13:07:21 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:22 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:22 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5 Jul 19 13:07:22 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:22 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.cb479e95-2a81-49a1-8a84-0e4a7958f6f5" returned: 0 in 0.370s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-cb479e95-2a81-49a1-8a84-0e4a7958f6f5" released by "_delete_snapshot" :: held 1.773s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" released by "delete_snapshot" :: held 1.822s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:22 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Created reservations ['0e3552d7-b1f3-4406-9001-d57a0383969b', '95aa18b3-bae1-42ec-aa73-176e17591d33', '14faaef8-60f8-4bb5-b424-c81219dcdeb1', '4a7dbbc8-bb62-475a-b620-b6120d785ab3'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Delete snapshot completed successfully. Jul 19 13:07:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e734836f-dbe6-4c3d-a15d-5425f27fee6e tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-cb479e95-2a81-49a1-8a84-0e4a7958f6f5-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Creating offline snapshot 60119a76-31a7-448b-a8ae-d9d29493e8e8 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53762d1-d29f-443c-b282-c002739c3a8e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:23 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:23 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:23 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:23 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 1G Jul 19 13:07:23 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:24 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 1G" returned: 0 in 0.533s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:24 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 Jul 19 13:07:24 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:24 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8" returned: 0 in 0.337s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:24 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 is being set with open permissions: ugo+rw Jul 19 13:07:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:24 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 Jul 19 13:07:24 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:24 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.633s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e58036ff-7c24-40ff-87da-11c9c41cd91e tempest-SnapshotsActionsTest-817208483 None] Create snapshot completed successfully Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-60119a76-31a7-448b-a8ae-d9d29493e8e8-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-60119a76-31a7-448b-a8ae-d9d29493e8e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-60119a76-31a7-448b-a8ae-d9d29493e8e8" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-60119a76-31a7-448b-a8ae-d9d29493e8e8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Deleting offline snapshot 60119a76-31a7-448b-a8ae-d9d29493e8e8 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] snapshot_file for this snap is: volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80038ed-ac41-4530-b6fa-518b7ca0737f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:25 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 Jul 19 13:07:25 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:26 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8" returned: 0 in 0.519s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ba86a-622a-47e7-91a1-84e805a7c8bf]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:26 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:26 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:26 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.482s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:26 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 Jul 19 13:07:26 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:27 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8" returned: 0 in 0.392s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:27 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8 Jul 19 13:07:27 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:27 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.60119a76-31a7-448b-a8ae-d9d29493e8e8" returned: 0 in 0.249s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-60119a76-31a7-448b-a8ae-d9d29493e8e8" released by "_delete_snapshot" :: held 1.756s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" released by "delete_snapshot" :: held 1.785s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:27 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Created reservations ['0beb31ab-3f66-4f78-9be7-c92600b45cc2', '046a938d-f159-4ab2-8842-d73c5d17eba2', 'fb410429-62b6-49f7-8348-0a79c2e72401', 'e551aa81-ebc4-4d2a-9f7f-cbf36814a158'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:27 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Delete snapshot completed successfully. Jul 19 13:07:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bad96083-c16a-4a29-8a33-e17b1ed06aeb tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-60119a76-31a7-448b-a8ae-d9d29493e8e8-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Creating offline snapshot b9ed9726-5344-4b9a-9225-2af06ba76ff5 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e65c6-3336-4f08-87a7-5de4375563fd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:28 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:28 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:28 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.378s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:28 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 1G Jul 19 13:07:28 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:28 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 1G" returned: 0 in 0.438s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:28 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 Jul 19 13:07:28 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:29 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5" returned: 0 in 0.327s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:29 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 is being set with open permissions: ugo+rw Jul 19 13:07:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:29 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 Jul 19 13:07:29 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:29 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.508s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4b220595-d3ad-4908-9a38-5f5aa76ebed1 tempest-SnapshotsActionsTest-817208483 None] Create snapshot completed successfully Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-b9ed9726-5344-4b9a-9225-2af06ba76ff5-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-b9ed9726-5344-4b9a-9225-2af06ba76ff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-b9ed9726-5344-4b9a-9225-2af06ba76ff5" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-b9ed9726-5344-4b9a-9225-2af06ba76ff5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Deleting offline snapshot b9ed9726-5344-4b9a-9225-2af06ba76ff5 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] snapshot_file for this snap is: volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ccf74d-37cc-41fd-a2ce-de1b259606e6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:30 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 Jul 19 13:07:30 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:30 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5" returned: 0 in 0.376s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d56f01-f7c8-479d-9785-f65ff4c8433d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:30 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:30 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:31 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.348s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:31 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 Jul 19 13:07:31 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:31 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5" returned: 0 in 0.381s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:31 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5 Jul 19 13:07:31 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:31 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.b9ed9726-5344-4b9a-9225-2af06ba76ff5" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-b9ed9726-5344-4b9a-9225-2af06ba76ff5" released by "_delete_snapshot" :: held 1.454s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" released by "delete_snapshot" :: held 1.477s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Created reservations ['9731c1c2-dd8d-4609-8ae6-b06f67488a96', '96e39474-70c7-4b62-8b64-9dfdf4ec2908', '992e5960-a1cf-4135-bc04-d51bee5c1b98', 'cc34fa5c-6ede-4871-a5b2-9ae474c7ae69'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:31 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Delete snapshot completed successfully. Jul 19 13:07:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f7ed0168-ada1-496b-af80-efe083f81164 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-b9ed9726-5344-4b9a-9225-2af06ba76ff5-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Creating offline snapshot db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:07:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1908c0-20a0-41e5-a269-c60d976892b0]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:32 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:32 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Flow 'volume_create_manager' (72a29262-107b-453f-be15-fc3783524668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2078320d-cd83-439d-8eeb-495cf28c90a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2078320d-cd83-439d-8eeb-495cf28c90a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2096695971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc156827-1d38-48bc-adcf-e922c75ec4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da0faef7d564b41820e44309f30c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:33Z,use_quota=True,user_id='6355856111a847589d24eeb1887bd946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda45d5b-271c-4f37-a2e9-8d0417b302e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda45d5b-271c-4f37-a2e9-8d0417b302e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db524d25-b3ec-4b93-94a8-db1a524e64b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db524d25-b3ec-4b93-94a8-db1a524e64b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc156827-1d38-48bc-adcf-e922c75ec4a1', 'volume_name': 'volume-dc156827-1d38-48bc-adcf-e922c75ec4a1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277854a0-3b28-4e58-a13f-3b286aec99ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277854a0-3b28-4e58-a13f-3b286aec99ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483255f-ac85-486e-9cd0-dfbb4e66b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:33 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Volume dc156827-1d38-48bc-adcf-e922c75ec4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc156827-1d38-48bc-adcf-e922c75ec4a1', 'volume_size': 1} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:33 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.400s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:33 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a 1G Jul 19 13:07:33 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:33 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a 1G" returned: 0 in 0.395s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:33 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a Jul 19 13:07:33 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:33 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" returned: 0 in 0.315s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:33 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a is being set with open permissions: ugo+rw Jul 19 13:07:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:33 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a Jul 19 13:07:33 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:34 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" returned: 0 in 0.266s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.487s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2096695971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc156827-1d38-48bc-adcf-e922c75ec4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da0faef7d564b41820e44309f30c4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:33Z,use_quota=True,user_id='6355856111a847589d24eeb1887bd946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Creating volume dc156827-1d38-48bc-adcf-e922c75ec4a1 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:07:34 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:34 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 1073741824 Jul 19 13:07:34 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-56d1712a-d6f0-47aa-a25d-47f0a80a6f20 tempest-SnapshotsActionsTest-817208483 None] Create snapshot completed successfully Jul 19 13:07:34 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 1073741824" returned: 0 in 0.441s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:34 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 Jul 19 13:07:34 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:34 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1" returned: 0 in 0.281s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:07:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483255f-ac85-486e-9cd0-dfbb4e66b007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc156827-1d38-48bc-adcf-e922c75ec4a1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3266c11-7443-4197-9185-2bc3d70aa2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Acquiring lock "cinder-quobyte-db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:35 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Volume volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 (dc156827-1d38-48bc-adcf-e922c75ec4a1): created successfully Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3266c11-7443-4197-9185-2bc3d70aa2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Flow 'volume_create_manager' (72a29262-107b-453f-be15-fc3783524668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Deleting offline snapshot db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] snapshot_file for this snap is: volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:07:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9a5e2382-71ee-457c-81ff-747047e3a15e tempest-VolumesServicesTestJSON-445759241 None] Created volume successfully. Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b054e-7cc7-4ac0-a071-8bd6c795980e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:35 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a Jul 19 13:07:35 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Acquiring lock "cinder-dc156827-1d38-48bc-adcf-e922c75ec4a1-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Lock "cinder-dc156827-1d38-48bc-adcf-e922c75ec4a1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Acquiring lock "cinder-quobyte-dc156827-1d38-48bc-adcf-e922c75ec4a1" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Lock "cinder-quobyte-dc156827-1d38-48bc-adcf-e922c75ec4a1" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bf1d72-887a-447d-819e-905a81631f91]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:35 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" returned: 0 in 0.409s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[adec3c96-5374-47c8-bed3-9a03d56cb9b4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:35 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 Jul 19 13:07:35 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:35 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:35 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:35 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:35 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1 Jul 19 13:07:35 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:35 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.393s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:35 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a Jul 19 13:07:35 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:36 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-dc156827-1d38-48bc-adcf-e922c75ec4a1" returned: 0 in 0.265s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Lock "cinder-quobyte-dc156827-1d38-48bc-adcf-e922c75ec4a1" released by "delete_volume" :: held 0.692s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Created reservations ['cec54d02-6666-4804-9d71-7e42d5124f9c', '3c02ea9f-9cb2-4a36-bf18-5f826e45bf24', '7368f1e5-a965-4ada-bf08-183cc737e8e4', '6d10eafa-a991-4b82-850c-593687d35c28'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:36 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:07:36 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:36 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" returned: 0 in 0.434s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:36 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a Jul 19 13:07:36 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:36 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.307s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:07:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Deleted volume successfully. Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b1f71020-e03f-4aaa-b03e-7a7882e08c5a tempest-VolumesServicesTestJSON-445759241 None] Lock "cinder-dc156827-1d38-48bc-adcf-e922c75ec4a1-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:36 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a" released by "_delete_snapshot" :: held 1.689s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" released by "delete_snapshot" :: held 1.729s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Created reservations ['cd60ab23-7c56-435b-aae3-6f515ae72639', 'e2c430c3-3ff7-4c4f-ade2-2748ffce6ee6', 'e3587084-9a3c-4f1f-936b-0983bdaef4c4', '34a34d99-d83f-4e73-bc2e-66c3b7729a60'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Delete snapshot completed successfully. Jul 19 13:07:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-62720e61-fa6b-42c8-82e7-6f9446950541 tempest-SnapshotsActionsTest-1568874989 None] Lock "cinder-db114ce0-4f7b-4dc3-95d3-b1a8ee989a6a-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "cinder-439e89e5-2ba1-44a0-b50a-52f5962e0d99-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-439e89e5-2ba1-44a0-b50a-52f5962e0d99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "cinder-quobyte-439e89e5-2ba1-44a0-b50a-52f5962e0d99" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-quobyte-439e89e5-2ba1-44a0-b50a-52f5962e0d99" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Deleting offline snapshot 439e89e5-2ba1-44a0-b50a-52f5962e0d99 of volume 0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] snapshot_file for this snap is: volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93c5fe3-f6ca-4e66-8ee1-8e67044924de]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:38 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:38 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:38 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.532s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec77ced-76d8-4c14-8440-f1110a13abdc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:38 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db Jul 19 13:07:38 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Flow 'volume_create_manager' (ef7971cf-00be-4c27-9bfb-bc3c9fdf90b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0904b8-bfda-4a84-8357-2aa8ffa61bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0904b8-bfda-4a84-8357-2aa8ffa61bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1896444168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5646eb-1ed8-4856-a38e-23def4696782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854f6b6c82f549fea0e3ce13e3c17636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:39Z,use_quota=True,user_id='aaed62ef7e2443bfa8c7dfe9cad2e16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785cd5ab-6391-4a47-a06f-dc7190afa0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785cd5ab-6391-4a47-a06f-dc7190afa0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fe1747-d160-465d-973a-0c072092c543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fe1747-d160-465d-973a-0c072092c543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5646eb-1ed8-4856-a38e-23def4696782', 'volume_name': 'volume-0b5646eb-1ed8-4856-a38e-23def4696782', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f11371-6698-4f77-80b8-5e2892d3605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f11371-6698-4f77-80b8-5e2892d3605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f6c45-a0f2-41ff-82c2-99e58c826538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:38 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Volume 0b5646eb-1ed8-4856-a38e-23def4696782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5646eb-1ed8-4856-a38e-23def4696782', 'volume_size': 1} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1896444168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5646eb-1ed8-4856-a38e-23def4696782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854f6b6c82f549fea0e3ce13e3c17636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:39Z,use_quota=True,user_id='aaed62ef7e2443bfa8c7dfe9cad2e16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Creating volume 0b5646eb-1ed8-4856-a38e-23def4696782 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:07:38 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:07:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:39 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 1073741824 Jul 19 13:07:39 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:39 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" returned: 0 in 0.603s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:39 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:39 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:39 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 1073741824" returned: 0 in 0.628s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:39 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.540s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:39 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 Jul 19 13:07:39 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:39 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99 Jul 19 13:07:39 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:39 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782" returned: 0 in 0.329s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:07:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f6c45-a0f2-41ff-82c2-99e58c826538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5646eb-1ed8-4856-a38e-23def4696782', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e43d9-57a7-4068-b38e-09f64c62f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Volume volume-0b5646eb-1ed8-4856-a38e-23def4696782 (0b5646eb-1ed8-4856-a38e-23def4696782): created successfully Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e43d9-57a7-4068-b38e-09f64c62f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:40 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Flow 'volume_create_manager' (ef7971cf-00be-4c27-9bfb-bc3c9fdf90b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db.439e89e5-2ba1-44a0-b50a-52f5962e0d99" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bf0a2f0a-7ef5-4c3f-a2f2-2471b1814f22 tempest-AttachVolumeTestJSON-1163101209 None] Created volume successfully. Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-quobyte-439e89e5-2ba1-44a0-b50a-52f5962e0d99" released by "_delete_snapshot" :: held 2.230s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" released by "delete_snapshot" :: held 2.272s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Created reservations ['acffe774-42b5-4fac-8376-3851dcd7c368', '7f49c3cc-49d4-4a6f-bd02-1fdf990b8b89', '68ed8bb0-446c-441f-a827-1d67973c7f21', 'b6a57522-6de6-4a77-bcb7-f37317222008'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Delete snapshot completed successfully. Jul 19 13:07:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-dbcc876d-48c9-45ea-ab7b-5fd3f245dc17 tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-439e89e5-2ba1-44a0-b50a-52f5962e0d99-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "cinder-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede58bf-a200-4ef2-bca1-a6c5d6d95260]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:41 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db Jul 19 13:07:41 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-01c840e7-9e9d-4ef6-aa41-db4123221044 req-364f43db-417f-4194-8da2-f83c72bf5840 tempest-AttachVolumeNegativeTest-1076077273 None] Terminate volume connection completed successfully. Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-01c840e7-9e9d-4ef6-aa41-db4123221044 req-364f43db-417f-4194-8da2-f83c72bf5840 tempest-AttachVolumeNegativeTest-1076077273 None] Deleting attachment 19ce5d9b-55d0-4913-90af-623eb201f231. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-df7ddc3e-72dc-49e1-b2b0-335a55726583 req-d41ade08-bcdf-4fc3-a9af-fa0995639b8c tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-df7ddc3e-72dc-49e1-b2b0-335a55726583 req-d41ade08-bcdf-4fc3-a9af-fa0995639b8c tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-df7ddc3e-72dc-49e1-b2b0-335a55726583 req-d41ade08-bcdf-4fc3-a9af-fa0995639b8c tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-df7ddc3e-72dc-49e1-b2b0-335a55726583 req-d41ade08-bcdf-4fc3-a9af-fa0995639b8c tempest-AttachVolumeTestJSON-1163101209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-0b5646eb-1ed8-4856-a38e-23def4696782', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0af211d2-e4b5-4680-8622-2f04a4e26989', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:07:42 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" returned: 0 in 0.617s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:42 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db Jul 19 13:07:42 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:42 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-df7ddc3e-72dc-49e1-b2b0-335a55726583 req-d41ade08-bcdf-4fc3-a9af-fa0995639b8c tempest-AttachVolumeTestJSON-1163101209 None] attachment_update completed successfully. Jul 19 13:07:42 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" returned: 0 in 0.309s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-quobyte-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db" released by "delete_volume" :: held 1.030s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:42 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:07:42 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Created reservations ['c6720ce9-a773-4a6f-b91d-77200fa39b06', '32a499bf-9fb1-4774-90f3-372c1f8571b3', '85e8ca3b-c60c-4690-a230-83ce47db32ab', '6dd1ac93-ac10-4322-9068-bcedf9136803'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:42 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:07:42 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:42 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.379s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 8 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:07:42 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.381s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:07:42 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Deleted volume successfully. Jul 19 13:07:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9b8aaca5-aeb6-4cb5-886c-bac7aa145ebd tempest-SnapshotsActionsTest-817208483 None] Lock "cinder-0b4c0189-8b9b-42ff-a3ae-11e5c4f7b2db-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Flow 'volume_create_manager' (be1f5ce0-fb39-492d-83e1-51a4cebc8312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac61f9a-ed59-48e8-bbc1-20fe75c9c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac61f9a-ed59-48e8-bbc1-20fe75c9c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2679226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164438c5-d386-4fba-8e59-2614d62438f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c52fa9b853af46568bb7bb7e3119e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:45Z,use_quota=True,user_id='49911314b3974e0a9256ed922b9b99c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cdb94b7-11d5-400d-a770-9fdc8c2b1bab),volume_type_id=8cdb94b7-11d5-400d-a770-9fdc8c2b1bab)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db1a414-985b-4f73-b1d0-a10f0691f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db1a414-985b-4f73-b1d0-a10f0691f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65720677-62ee-45f4-876a-1feab3f383bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65720677-62ee-45f4-876a-1feab3f383bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164438c5-d386-4fba-8e59-2614d62438f3', 'volume_name': 'volume-164438c5-d386-4fba-8e59-2614d62438f3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cc328a-a15a-4260-821f-0eda97743f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cc328a-a15a-4260-821f-0eda97743f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703743e0-ee4f-4063-bcdb-2b24ee82c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:45 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Volume 164438c5-d386-4fba-8e59-2614d62438f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164438c5-d386-4fba-8e59-2614d62438f3', 'volume_size': 1} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2679226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164438c5-d386-4fba-8e59-2614d62438f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c52fa9b853af46568bb7bb7e3119e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:07:45Z,use_quota=True,user_id='49911314b3974e0a9256ed922b9b99c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cdb94b7-11d5-400d-a770-9fdc8c2b1bab),volume_type_id=8cdb94b7-11d5-400d-a770-9fdc8c2b1bab)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Creating volume 164438c5-d386-4fba-8e59-2614d62438f3 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:07:45 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:45 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 1073741824 Jul 19 13:07:45 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:45 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 1073741824" returned: 0 in 0.664s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:45 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 Jul 19 13:07:45 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:46 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3" returned: 0 in 0.384s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:07:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703743e0-ee4f-4063-bcdb-2b24ee82c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164438c5-d386-4fba-8e59-2614d62438f3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0518a4f-b999-47a4-a3e1-b3623b307835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:46 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Volume volume-164438c5-d386-4fba-8e59-2614d62438f3 (164438c5-d386-4fba-8e59-2614d62438f3): created successfully Jul 19 13:07:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0518a4f-b999-47a4-a3e1-b3623b307835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Flow 'volume_create_manager' (be1f5ce0-fb39-492d-83e1-51a4cebc8312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9ecf3441-3f73-4800-b814-d802b47884c7 tempest-VolumeTypesAccessTest-1405537454 None] Created volume successfully. Jul 19 13:07:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Acquiring lock "cinder-164438c5-d386-4fba-8e59-2614d62438f3-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Lock "cinder-164438c5-d386-4fba-8e59-2614d62438f3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Acquiring lock "cinder-quobyte-164438c5-d386-4fba-8e59-2614d62438f3" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:07:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Lock "cinder-quobyte-164438c5-d386-4fba-8e59-2614d62438f3" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:07:47 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f53bb-7553-4717-829f-d01cab7d9c99]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:07:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:47 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 Jul 19 13:07:47 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:48 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3" returned: 0 in 0.721s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:48 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3 Jul 19 13:07:48 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:48 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-164438c5-d386-4fba-8e59-2614d62438f3" returned: 0 in 0.442s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Lock "cinder-quobyte-164438c5-d386-4fba-8e59-2614d62438f3" released by "delete_volume" :: held 1.235s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:48 devstack cinder-volume[87305]: WARNING cinder.quota [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-803568609 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-803568609, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:07:48 devstack cinder-volume[87305]: WARNING cinder.quota [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-803568609 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-803568609, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Created reservations ['e89021df-44e5-4c0e-9081-0abaa60ce1c6', '307da428-d218-4edc-8690-fb660f0b4265', '0a561f75-7c22-49a0-9f88-f85f156f3634', '96153dd5-1aaf-4dd8-81d8-498705604115'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:48 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:07:48 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:07:49 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jul 19 13:07:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.437s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:07:49 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:07:49 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Deleted volume successfully. Jul 19 13:07:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b2ded7b-4f04-475d-a0e6-f7f7cd14d00c tempest-VolumeTypesAccessTest-1405537454 None] Lock "cinder-164438c5-d386-4fba-8e59-2614d62438f3-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:07:58 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=63,cinder:INSERT=17,cinder:UPDATE=76,cinder:DELETE=6 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=68,cinder:INSERT=22,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Flow 'volume_create_manager' (6dd16fbe-9c08-4148-a469-a5f9ff546174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b2c6fc-ea8c-4a8a-b6e2-89c2be1b462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b2c6fc-ea8c-4a8a-b6e2-89c2be1b462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-529497115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df59d6b-9ee2-43d4-88bc-08c667988577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d6ef5548794c2aae4f76ed33661e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:00Z,use_quota=True,user_id='fde446c0cdd74da5b83183c5c82bc162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(128d5dfd-a055-4e8f-8e92-2efcb903cc37),volume_type_id=128d5dfd-a055-4e8f-8e92-2efcb903cc37)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fe0118-b386-4916-bd09-cf7fb8fb66bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fe0118-b386-4916-bd09-cf7fb8fb66bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a1d019-9c23-495c-8f05-a7b2d283faf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a1d019-9c23-495c-8f05-a7b2d283faf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df59d6b-9ee2-43d4-88bc-08c667988577', 'volume_name': 'volume-6df59d6b-9ee2-43d4-88bc-08c667988577', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2705346e-0c2c-4438-82ce-92f865c39fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2705346e-0c2c-4438-82ce-92f865c39fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f8adf0-07cc-4d49-a14b-adab76327d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:07:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Volume 6df59d6b-9ee2-43d4-88bc-08c667988577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df59d6b-9ee2-43d4-88bc-08c667988577', 'volume_size': 1} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-529497115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df59d6b-9ee2-43d4-88bc-08c667988577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d6ef5548794c2aae4f76ed33661e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:00Z,use_quota=True,user_id='fde446c0cdd74da5b83183c5c82bc162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(128d5dfd-a055-4e8f-8e92-2efcb903cc37),volume_type_id=128d5dfd-a055-4e8f-8e92-2efcb903cc37)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Creating volume 6df59d6b-9ee2-43d4-88bc-08c667988577 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:07:59 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:07:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:07:59 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 1073741824 Jul 19 13:07:59 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:00 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 1073741824" returned: 0 in 0.618s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:00 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 Jul 19 13:08:00 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:00 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577" returned: 0 in 0.426s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f8adf0-07cc-4d49-a14b-adab76327d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df59d6b-9ee2-43d4-88bc-08c667988577', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6172508-a884-4fe3-91d7-ad5fb1739737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:00 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Volume volume-6df59d6b-9ee2-43d4-88bc-08c667988577 (6df59d6b-9ee2-43d4-88bc-08c667988577): created successfully Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6172508-a884-4fe3-91d7-ad5fb1739737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Flow 'volume_create_manager' (6dd16fbe-9c08-4148-a469-a5f9ff546174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-10dd4d59-79f1-4f23-b6d2-0b8b5664c0ad tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Created volume successfully. Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:03 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:03 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:03 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.455s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:03 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-dbc7b35a-7f50-4768-aeaa-ad293b0e71b7 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Retype volume completed successfully. Jul 19 13:08:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Acquiring lock "cinder-6df59d6b-9ee2-43d4-88bc-08c667988577-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "cinder-6df59d6b-9ee2-43d4-88bc-08c667988577-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Acquiring lock "cinder-quobyte-6df59d6b-9ee2-43d4-88bc-08c667988577" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "cinder-quobyte-6df59d6b-9ee2-43d4-88bc-08c667988577" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:04 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90828148-6301-431f-a3d5-b9c9205c72a8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:04 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 Jul 19 13:08:04 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:05 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577" returned: 0 in 0.592s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:05 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577 Jul 19 13:08:05 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:05 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6df59d6b-9ee2-43d4-88bc-08c667988577" returned: 0 in 0.409s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "cinder-quobyte-6df59d6b-9ee2-43d4-88bc-08c667988577" released by "delete_volume" :: held 1.069s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:05 devstack cinder-volume[87305]: WARNING cinder.quota [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:08:05 devstack cinder-volume[87305]: WARNING cinder.quota [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:08:05 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Created reservations ['e7e9ea9c-95b1-4d0c-9a9e-2da99caf0ae5', '301c4065-eff0-4561-9e4d-8c07974f253a', '8b23a116-34be-4cf3-9261-c252b6ce1325', '13b77fcb-0752-4145-80e2-eeb9ff802c17'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:06 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:06 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:06 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.313s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Deleted volume successfully. Jul 19 13:08:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6ddb282-b71d-46f4-ad2a-406a0b436ad6 tempest-VolumeRetypeWithoutMigrationTest-630882831 None] Lock "cinder-6df59d6b-9ee2-43d4-88bc-08c667988577-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-3f0877bc-1293-4f12-9dc5-3035dc805bfd req-787e3fc8-d6cc-444b-ae2d-57fd95eb93d6 tempest-AttachVolumeTestJSON-1163101209 None] Terminate volume connection completed successfully. Jul 19 13:08:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-3f0877bc-1293-4f12-9dc5-3035dc805bfd req-787e3fc8-d6cc-444b-ae2d-57fd95eb93d6 tempest-AttachVolumeTestJSON-1163101209 None] Deleting attachment 0af211d2-e4b5-4680-8622-2f04a4e26989. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Flow 'volume_create_manager' (c157c42d-010f-4a41-8db8-f0f7fb30e69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08777c8-97d3-4dbe-b093-c6beca43c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08777c8-97d3-4dbe-b093-c6beca43c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1283717784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f154d5-22c5-4f41-81b7-229c4184fd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c0af08b04046ecb8f7e887e65d865f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:14Z,use_quota=True,user_id='57ea0e4b120d46f7a0a3c94338b30606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb5534f-1f0e-4474-9adb-45a701aba8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb5534f-1f0e-4474-9adb-45a701aba8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b43fd1-b489-414b-9549-8b4aae1f7e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b43fd1-b489-414b-9549-8b4aae1f7e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f154d5-22c5-4f41-81b7-229c4184fd0f', 'volume_name': 'volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c672572-48f9-432d-9571-cf6a28a6cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c672572-48f9-432d-9571-cf6a28a6cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29977524-e5ca-4136-a245-68cb8964c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Volume f7f154d5-22c5-4f41-81b7-229c4184fd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f', 'volume_size': 1} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1283717784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f154d5-22c5-4f41-81b7-229c4184fd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c0af08b04046ecb8f7e887e65d865f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:14Z,use_quota=True,user_id='57ea0e4b120d46f7a0a3c94338b30606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Creating volume f7f154d5-22c5-4f41-81b7-229c4184fd0f {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:14 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:14 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f 1073741824 Jul 19 13:08:14 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:14 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f 1073741824" returned: 0 in 0.513s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:14 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f Jul 19 13:08:14 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:15 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f" returned: 0 in 0.330s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29977524-e5ca-4136-a245-68cb8964c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7100aa42-7d61-41c5-8acb-826434ffdea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:15 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Volume volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f (f7f154d5-22c5-4f41-81b7-229c4184fd0f): created successfully Jul 19 13:08:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7100aa42-7d61-41c5-8acb-826434ffdea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Flow 'volume_create_manager' (c157c42d-010f-4a41-8db8-f0f7fb30e69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-89366c9e-3177-481e-a8df-5c27426d220f tempest-VolumesTransfersTest-1317852480 None] Created volume successfully. Jul 19 13:08:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c44e5690-d411-463a-88e9-e5f91c760984 tempest-VolumesTransfersTest-472353263 None] Transfer volume completed successfully. Jul 19 13:08:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Acquiring lock "cinder-f7f154d5-22c5-4f41-81b7-229c4184fd0f-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Lock "cinder-f7f154d5-22c5-4f41-81b7-229c4184fd0f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Acquiring lock "cinder-quobyte-f7f154d5-22c5-4f41-81b7-229c4184fd0f" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Lock "cinder-quobyte-f7f154d5-22c5-4f41-81b7-229c4184fd0f" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa085ae-4891-4da1-b100-436a652f0243]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:19 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f Jul 19 13:08:19 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:19 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f" returned: 0 in 0.469s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:19 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f Jul 19 13:08:19 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:19 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f7f154d5-22c5-4f41-81b7-229c4184fd0f" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Lock "cinder-quobyte-f7f154d5-22c5-4f41-81b7-229c4184fd0f" released by "delete_volume" :: held 0.877s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Created reservations ['258e7a1a-4531-4603-a1b2-2b1977c7e0e0', '920cb5d6-406b-4455-95d0-80629fc6bc44', 'e91e074f-4fed-4342-b2b0-e2dda7071cdb', '17aede0c-0368-4fe2-98ca-fc28d741555d'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:20 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:20 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:20 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.280s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Deleted volume successfully. Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-495b5cce-4cfc-4fcc-bd54-6d5b3249e769 tempest-VolumesTransfersTest-778611852 None] Lock "cinder-f7f154d5-22c5-4f41-81b7-229c4184fd0f-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Flow 'volume_create_manager' (b26e7f3a-2abe-4c01-997b-b5f8bfb5c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d3bcd5-6020-4804-bc82-9026277d7952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d3bcd5-6020-4804-bc82-9026277d7952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1556593794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a4b5b8-1584-4ce6-bdec-4dc0fd154f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c0af08b04046ecb8f7e887e65d865f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:21Z,use_quota=True,user_id='57ea0e4b120d46f7a0a3c94338b30606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52be1cc-d179-4699-b4c9-c5b4d0f2aa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52be1cc-d179-4699-b4c9-c5b4d0f2aa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b963fd3-4921-4010-874f-14dd4ca330e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b963fd3-4921-4010-874f-14dd4ca330e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a4b5b8-1584-4ce6-bdec-4dc0fd154f81', 'volume_name': 'volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c20be95-4c8d-4805-94ef-58f440230739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c20be95-4c8d-4805-94ef-58f440230739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890000a-7541-400a-89e0-07b9a558f78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:20 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Volume 48a4b5b8-1584-4ce6-bdec-4dc0fd154f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81', 'volume_size': 1} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1556593794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a4b5b8-1584-4ce6-bdec-4dc0fd154f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c0af08b04046ecb8f7e887e65d865f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:21Z,use_quota=True,user_id='57ea0e4b120d46f7a0a3c94338b30606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Creating volume 48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:20 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:20 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 1073741824 Jul 19 13:08:20 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:21 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 1073741824" returned: 0 in 0.502s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:21 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 Jul 19 13:08:21 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:21 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81" returned: 0 in 0.332s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890000a-7541-400a-89e0-07b9a558f78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a44bd-7f89-4efa-ad52-b7c6e5e3ae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:21 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Volume volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 (48a4b5b8-1584-4ce6-bdec-4dc0fd154f81): created successfully Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a44bd-7f89-4efa-ad52-b7c6e5e3ae10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Flow 'volume_create_manager' (b26e7f3a-2abe-4c01-997b-b5f8bfb5c581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1893e1a1-da72-40ad-8f77-08beafa4c181 tempest-VolumesTransfersTest-1317852480 None] Created volume successfully. Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Flow 'volume_create_manager' (24f93cc4-5042-4f10-b958-98303dddba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700063b8-27e5-42b6-9fe6-e1009d413f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700063b8-27e5-42b6-9fe6-e1009d413f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-30527643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11228518-a4f0-4a97-a38a-da1ca5ed6373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a050436ab459db6cfd49ed09b7447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:22Z,use_quota=True,user_id='04d7bb2f7d3942dfa9cf8a6ea2d44585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a92d6f-4e84-47c2-8d27-c1613625f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a92d6f-4e84-47c2-8d27-c1613625f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81db9de2-775f-4c6c-8632-a1fca627b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81db9de2-775f-4c6c-8632-a1fca627b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11228518-a4f0-4a97-a38a-da1ca5ed6373', 'volume_name': 'volume-11228518-a4f0-4a97-a38a-da1ca5ed6373', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c09991a-e225-4d73-99a4-d055b06e1c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c09991a-e225-4d73-99a4-d055b06e1c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f67320b-b6d3-4826-b5ed-0c15b477e50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:21 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Volume 11228518-a4f0-4a97-a38a-da1ca5ed6373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11228518-a4f0-4a97-a38a-da1ca5ed6373', 'volume_size': 1} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-30527643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11228518-a4f0-4a97-a38a-da1ca5ed6373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696a050436ab459db6cfd49ed09b7447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:22Z,use_quota=True,user_id='04d7bb2f7d3942dfa9cf8a6ea2d44585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Creating volume 11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:21 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:21 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 1073741824 Jul 19 13:08:21 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:22 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 1073741824" returned: 0 in 0.430s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:22 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 Jul 19 13:08:22 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:22 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373" returned: 0 in 0.269s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f67320b-b6d3-4826-b5ed-0c15b477e50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11228518-a4f0-4a97-a38a-da1ca5ed6373', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7079073-c531-447b-a0ad-c53108d27a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:22 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Volume volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 (11228518-a4f0-4a97-a38a-da1ca5ed6373): created successfully Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7079073-c531-447b-a0ad-c53108d27a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Flow 'volume_create_manager' (24f93cc4-5042-4f10-b958-98303dddba49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c98995e8-64af-43c0-a6cf-1555f52312c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Created volume successfully. Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Creating offline snapshot ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 of volume 11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f58e96-71f9-4122-b27e-86c4fd3b11dc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Acquiring lock "cinder-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Lock "cinder-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Acquiring lock "cinder-quobyte-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Lock "cinder-quobyte-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81" acquired by "delete_volume" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07bc29-a04f-4da3-b848-231d0d18c49a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:23 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 Jul 19 13:08:23 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:23 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 Jul 19 13:08:23 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:23 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373" returned: 0 in 0.463s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:23 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 1G Jul 19 13:08:23 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:23 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81" returned: 0 in 0.417s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:23 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81 Jul 19 13:08:23 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:24 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81" returned: 0 in 0.265s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Lock "cinder-quobyte-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81" released by "delete_volume" :: held 0.734s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:24 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 1G" returned: 0 in 0.479s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Created reservations ['be488588-ad29-4a9f-929c-4a8a1bcdf60a', '499db59c-6397-43a1-bcc6-8a609654ecd2', '7a533a30-e1df-4955-bbcf-b2cb3cec025b', 'ae82ebfc-0e0d-4cc5-8b24-c1fdcd2f69c7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:08:24 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 Jul 19 13:08:24 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:24 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:24 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:24 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.306s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Deleted volume successfully. Jul 19 13:08:24 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" returned: 0 in 0.506s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:24 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 is being set with open permissions: ugo+rw Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ab2860c9-0378-474e-9298-5e2334c10dbc tempest-VolumesTransfersTest-778611852 None] Lock "cinder-48a4b5b8-1584-4ce6-bdec-4dc0fd154f81-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:24 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 Jul 19 13:08:24 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:24 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:24 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.info Jul 19 13:08:24 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:25 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.info" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:25 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.info is being set with open permissions: ugo+rw Jul 19 13:08:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:25 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.info Jul 19 13:08:25 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:25 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.info" returned: 0 in 0.261s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8308fe64-633a-43ca-84e4-e183576577e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Create snapshot completed successfully Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "cinder-ab558a31-a0e1-4da2-baef-8e0e3d00f7a5-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-ab558a31-a0e1-4da2-baef-8e0e3d00f7a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "cinder-quobyte-11228518-a4f0-4a97-a38a-da1ca5ed6373" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-quobyte-11228518-a4f0-4a97-a38a-da1ca5ed6373" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "cinder-quobyte-ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-quobyte-ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Deleting offline snapshot ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 of volume 11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] snapshot_file for this snap is: volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e1c96-2a3c-47ed-8bee-7feb97c9cdf6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:27 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 Jul 19 13:08:27 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:27 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" returned: 0 in 0.564s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11228518-a4f0-4a97-a38a-da1ca5ed6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e9d55a-cabd-4648-9908-3a1ac4d5aea8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:27 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 Jul 19 13:08:27 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Flow 'volume_create_manager' (a925b448-0562-4bfd-b864-0d30c2383ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deeafc47-6903-4f0d-84e5-ac02cdcd7960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deeafc47-6903-4f0d-84e5-ac02cdcd7960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-951458670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f3f6a1-ca4e-4833-ae94-4fd4970f0315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7a3e0d0e8440aeb6ec61b9475db3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:28Z,use_quota=True,user_id='15897bf333b54af7a099532c7f6c51ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93774097-606f-4abb-9a14-b3c80e2ca71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93774097-606f-4abb-9a14-b3c80e2ca71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5642ce-82db-43bb-8332-d2663534769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5642ce-82db-43bb-8332-d2663534769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f3f6a1-ca4e-4833-ae94-4fd4970f0315', 'volume_name': 'volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce0d093-1dbe-4568-9e73-66f265a974c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce0d093-1dbe-4568-9e73-66f265a974c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356d4739-7fc7-4442-b0b1-eb7cb5e4762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:27 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Volume 03f3f6a1-ca4e-4833-ae94-4fd4970f0315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315', 'volume_size': 1} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-951458670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f3f6a1-ca4e-4833-ae94-4fd4970f0315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7a3e0d0e8440aeb6ec61b9475db3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:28Z,use_quota=True,user_id='15897bf333b54af7a099532c7f6c51ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Creating volume 03f3f6a1-ca4e-4833-ae94-4fd4970f0315 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:27 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:27 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 1073741824 Jul 19 13:08:27 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:28 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373" returned: 0 in 0.534s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:28 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 Jul 19 13:08:28 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:28 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 1073741824" returned: 0 in 0.613s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:28 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 Jul 19 13:08:28 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:28 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" returned: 0 in 0.532s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:28 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5 Jul 19 13:08:28 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:28 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356d4739-7fc7-4442-b0b1-eb7cb5e4762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498f04e9-5e6b-47e5-839d-9d398e1532ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:28 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Volume volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 (03f3f6a1-ca4e-4833-ae94-4fd4970f0315): created successfully Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498f04e9-5e6b-47e5-839d-9d398e1532ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Flow 'volume_create_manager' (a925b448-0562-4bfd-b864-0d30c2383ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:28 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-19ba3ce1-25e8-4a06-8c66-8bcf02a16171 tempest-AttachVolumeNegativeTest-1076077273 None] Created volume successfully. Jul 19 13:08:29 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373.ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" returned: 0 in 0.372s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-quobyte-ab558a31-a0e1-4da2-baef-8e0e3d00f7a5" released by "_delete_snapshot" :: held 2.175s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-quobyte-11228518-a4f0-4a97-a38a-da1ca5ed6373" released by "delete_snapshot" :: held 2.206s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:29 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Created reservations ['55137673-cf9a-4953-9c88-cee39805627b', '17833e6d-acef-4173-bc2f-ebe66f664576', '5c85efab-01ea-47dc-8535-2e6913baf356', '951e7af8-f8ce-4ce8-8fda-e401722757e8'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:08:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Delete snapshot completed successfully. Jul 19 13:08:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2a1cf2ed-f6a1-42ed-891c-ceafa2e6c787 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-ab558a31-a0e1-4da2-baef-8e0e3d00f7a5-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "cinder-11228518-a4f0-4a97-a38a-da1ca5ed6373-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-11228518-a4f0-4a97-a38a-da1ca5ed6373-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "cinder-quobyte-11228518-a4f0-4a97-a38a-da1ca5ed6373" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-quobyte-11228518-a4f0-4a97-a38a-da1ca5ed6373" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec0847-0833-497f-a022-c7bfe6dd7015]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:30 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 Jul 19 13:08:30 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-67e73b70-9e7f-495a-8471-eff7cc52845b req-35fa7cc7-92eb-4a42-86c3-4a3d60b39304 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-67e73b70-9e7f-495a-8471-eff7cc52845b req-35fa7cc7-92eb-4a42-86c3-4a3d60b39304 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-67e73b70-9e7f-495a-8471-eff7cc52845b req-35fa7cc7-92eb-4a42-86c3-4a3d60b39304 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-67e73b70-9e7f-495a-8471-eff7cc52845b req-35fa7cc7-92eb-4a42-86c3-4a3d60b39304 tempest-AttachVolumeNegativeTest-1076077273 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f0e0d31-3ef7-4eb3-9392-fddf4673a684', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:08:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-67e73b70-9e7f-495a-8471-eff7cc52845b req-35fa7cc7-92eb-4a42-86c3-4a3d60b39304 tempest-AttachVolumeNegativeTest-1076077273 None] attachment_update completed successfully. Jul 19 13:08:30 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373" returned: 0 in 0.510s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:30 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373 Jul 19 13:08:30 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:31 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-11228518-a4f0-4a97-a38a-da1ca5ed6373" returned: 0 in 0.351s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-quobyte-11228518-a4f0-4a97-a38a-da1ca5ed6373" released by "delete_volume" :: held 0.976s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (c6c4aad0-fff4-45c8-bf74-312ab4dd946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534aa476-bb9b-447b-b293-311c041875f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534aa476-bb9b-447b-b293-311c041875f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-445324697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167c9a8a-150b-4971-ba7a-b12a72c299df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:31Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f869b-0975-45ad-8e5b-e049161b2ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f869b-0975-45ad-8e5b-e049161b2ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65807f8-c15e-4ae0-9833-0b15b4646116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65807f8-c15e-4ae0-9833-0b15b4646116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167c9a8a-150b-4971-ba7a-b12a72c299df', 'volume_name': 'volume-167c9a8a-150b-4971-ba7a-b12a72c299df', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdc5e8c-017d-4425-9967-3c0554c91fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdc5e8c-017d-4425-9967-3c0554c91fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c767f78f-55ad-4e21-8048-0dc745af34be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:31 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Volume 167c9a8a-150b-4971-ba7a-b12a72c299df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167c9a8a-150b-4971-ba7a-b12a72c299df', 'volume_size': 1} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-445324697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167c9a8a-150b-4971-ba7a-b12a72c299df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:31Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Creating volume 167c9a8a-150b-4971-ba7a-b12a72c299df {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:31 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:31 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df 1073741824 Jul 19 13:08:31 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Created reservations ['489ca36d-b146-44eb-80eb-78465fb15934', '0f3e2abb-04fa-442d-83b4-f4ca5fe5d5e6', '8f8f51ca-95aa-4567-853a-383dd0f93202', 'e2fafeaf-a281-483e-a4fd-b70b5c517e1a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:31 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:31 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:32 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.311s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Deleted volume successfully. Jul 19 13:08:32 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df 1073741824" returned: 0 in 0.572s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13e2174a-2b6c-41dc-8318-0359c073cf96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1053936922 None] Lock "cinder-11228518-a4f0-4a97-a38a-da1ca5ed6373-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:32 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df Jul 19 13:08:32 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:32 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c767f78f-55ad-4e21-8048-0dc745af34be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167c9a8a-150b-4971-ba7a-b12a72c299df', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6471717-ddfd-4ea9-a78e-29e30fa035b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:32 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Volume volume-167c9a8a-150b-4971-ba7a-b12a72c299df (167c9a8a-150b-4971-ba7a-b12a72c299df): created successfully Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6471717-ddfd-4ea9-a78e-29e30fa035b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (c6c4aad0-fff4-45c8-bf74-312ab4dd946f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1d6523b6-95b7-43c0-86cd-2812fae32fec tempest-VolumesGetTest-1491883992 None] Created volume successfully. Jul 19 13:08:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-25648709-b66e-4ee5-a80e-710e5e978538 req-2f4b1f4e-44ee-4c60-bb1d-1e33ef1f5749 tempest-AttachVolumeNegativeTest-1076077273 None] Terminate volume connection completed successfully. Jul 19 13:08:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-25648709-b66e-4ee5-a80e-710e5e978538 req-2f4b1f4e-44ee-4c60-bb1d-1e33ef1f5749 tempest-AttachVolumeNegativeTest-1076077273 None] Deleting attachment 0f0e0d31-3ef7-4eb3-9392-fddf4673a684. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (9bd64eb5-bac9-494f-8bf6-edaf2d934b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1b9857-65cb-4a27-b422-8a9a02dc611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1b9857-65cb-4a27-b422-8a9a02dc611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-72329305',display_name='tempest-VolumesGetTest-Volume-1026789324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aed58bb-e800-4722-8745-508a91106e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:34Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0eb04b7-3ba6-4fb9-a18e-964a2035f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0eb04b7-3ba6-4fb9-a18e-964a2035f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2e98ca-980a-4f66-91da-91f783f58b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2e98ca-980a-4f66-91da-91f783f58b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aed58bb-e800-4722-8745-508a91106e23', 'volume_name': 'volume-3aed58bb-e800-4722-8745-508a91106e23', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275d1f3b-c671-473e-8aeb-3bb962297730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275d1f3b-c671-473e-8aeb-3bb962297730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c730e3-f7b0-40f1-8648-17b63097f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:34 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Volume 3aed58bb-e800-4722-8745-508a91106e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aed58bb-e800-4722-8745-508a91106e23', 'volume_size': 1} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-72329305',display_name='tempest-VolumesGetTest-Volume-1026789324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aed58bb-e800-4722-8745-508a91106e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:34Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Creating volume 3aed58bb-e800-4722-8745-508a91106e23 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:34 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:34 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 1073741824 Jul 19 13:08:34 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:35 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 1073741824" returned: 0 in 0.646s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:35 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 Jul 19 13:08:35 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:35 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c730e3-f7b0-40f1-8648-17b63097f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aed58bb-e800-4722-8745-508a91106e23', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a9fc33-0605-4ab2-b07b-769a2cb902c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:35 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Volume volume-3aed58bb-e800-4722-8745-508a91106e23 (3aed58bb-e800-4722-8745-508a91106e23): created successfully Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a9fc33-0605-4ab2-b07b-769a2cb902c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (9bd64eb5-bac9-494f-8bf6-edaf2d934b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b09cdb70-ce39-440e-919e-47ea831056f0 tempest-VolumesGetTest-1491883992 None] Created volume successfully. Jul 19 13:08:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-3aed58bb-e800-4722-8745-508a91106e23-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Lock "cinder-3aed58bb-e800-4722-8745-508a91106e23-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-3aed58bb-e800-4722-8745-508a91106e23" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-3aed58bb-e800-4722-8745-508a91106e23" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:36 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8b8616-6085-4873-979d-e91dd146e12b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:36 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 Jul 19 13:08:36 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:37 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23" returned: 0 in 0.364s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:37 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23 Jul 19 13:08:37 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:37 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3aed58bb-e800-4722-8745-508a91106e23" returned: 0 in 0.274s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-3aed58bb-e800-4722-8745-508a91106e23" released by "delete_volume" :: held 0.683s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Created reservations ['b599a675-714a-4a36-a789-4fcd95c3c95a', 'b3496c1c-b53d-46a9-a7e6-6251c1bc7f73', '652bb491-72a6-433c-8d72-6d3420bd7112', '15cd104e-ed23-4459-9e04-32711e36ada9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:37 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:37 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:37 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.288s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:37 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Deleted volume successfully. Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-57a73a9b-5693-4604-b448-329ec0442481 tempest-VolumesGetTest-1491883992 None] Lock "cinder-3aed58bb-e800-4722-8745-508a91106e23-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-167c9a8a-150b-4971-ba7a-b12a72c299df-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Lock "cinder-167c9a8a-150b-4971-ba7a-b12a72c299df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-167c9a8a-150b-4971-ba7a-b12a72c299df" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-167c9a8a-150b-4971-ba7a-b12a72c299df" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e153f-3135-42ee-9557-d15d9c060c4a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:38 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df Jul 19 13:08:38 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:38 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df" returned: 0 in 0.437s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:38 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df Jul 19 13:08:38 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:38 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-167c9a8a-150b-4971-ba7a-b12a72c299df" returned: 0 in 0.278s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-167c9a8a-150b-4971-ba7a-b12a72c299df" released by "delete_volume" :: held 0.767s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Created reservations ['ea20f702-3cfe-48bf-a7b7-fa8d3e0f1ba4', 'e9762ced-03cf-489f-84fc-4574bd51d851', 'e38052b4-c486-4a43-b22a-373631e68445', '9eccf685-dd67-4f39-9484-2619a70a09b5'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:38 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:38 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:39 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.413s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:39 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Deleted volume successfully. Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fdbd4a6-27bd-42ea-9eb7-f0be1410cb9e tempest-VolumesGetTest-1491883992 None] Lock "cinder-167c9a8a-150b-4971-ba7a-b12a72c299df-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (94e4b90e-aef7-4379-81b8-2ad527764255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24e26f8-659f-4e45-be7b-c8f82a682ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24e26f8-659f-4e45-be7b-c8f82a682ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-865913911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760a4948-b64a-414e-8794-e01226611f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:40Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85338297-a0e5-49d3-a494-f8c13d8b8adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85338297-a0e5-49d3-a494-f8c13d8b8adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee62e34-2c52-4818-a5ee-cf11b1dee1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee62e34-2c52-4818-a5ee-cf11b1dee1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760a4948-b64a-414e-8794-e01226611f2e', 'volume_name': 'volume-760a4948-b64a-414e-8794-e01226611f2e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2100a13-65c4-4468-9b56-a0b00554b074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2100a13-65c4-4468-9b56-a0b00554b074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1554d4-3093-4168-8ebc-6e2101161762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:39 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Volume 760a4948-b64a-414e-8794-e01226611f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760a4948-b64a-414e-8794-e01226611f2e', 'volume_size': 1} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-865913911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760a4948-b64a-414e-8794-e01226611f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:40Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Creating volume 760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:39 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:39 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e 1073741824 Jul 19 13:08:39 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:40 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e 1073741824" returned: 0 in 0.474s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:40 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e Jul 19 13:08:40 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:40 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e" returned: 0 in 0.288s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1554d4-3093-4168-8ebc-6e2101161762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760a4948-b64a-414e-8794-e01226611f2e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbfb89a-12a8-4264-bd95-25a5ace89302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Volume volume-760a4948-b64a-414e-8794-e01226611f2e (760a4948-b64a-414e-8794-e01226611f2e): created successfully Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbfb89a-12a8-4264-bd95-25a5ace89302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (94e4b90e-aef7-4379-81b8-2ad527764255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f2b82433-15a7-405d-aafe-915a50d2b3e9 tempest-VolumesGetTest-1491883992 None] Created volume successfully. Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:42 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:08:42 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (c8868e6d-2fc7-4c64-854a-d3e9a12cb316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c2058a-bac0-455c-9132-a269a6976668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c2058a-bac0-455c-9132-a269a6976668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-150103517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fc0ada-95d4-4745-98e6-bf34707302ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=760a4948-b64a-414e-8794-e01226611f2e,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:42Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523c3ce1-d3e2-4657-85f7-f63d60359bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523c3ce1-d3e2-4657-85f7-f63d60359bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee87d72-0643-4ec7-a22d-2496657618d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee87d72-0643-4ec7-a22d-2496657618d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a4fc0ada-95d4-4745-98e6-bf34707302ff', 'volume_name': 'volume-a4fc0ada-95d4-4745-98e6-bf34707302ff', 'volume_size': 1, 'source_volid': '760a4948-b64a-414e-8794-e01226611f2e', 'source_volstatus': 'available'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6d945a-61cb-4f47-a89e-148d62172e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6d945a-61cb-4f47-a89e-148d62172e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2522f626-07c5-4c5a-8791-2a1e7d04cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:42 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Volume a4fc0ada-95d4-4745-98e6-bf34707302ff: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a4fc0ada-95d4-4745-98e6-bf34707302ff', 'volume_size': 1, 'source_volid': '760a4948-b64a-414e-8794-e01226611f2e', 'source_volstatus': 'available'} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:42 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Cloning volume 760a4948-b64a-414e-8794-e01226611f2e to volume a4fc0ada-95d4-4745-98e6-bf34707302ff Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Creating offline snapshot 86cc1c88-5234-4e97-a0aa-3677a0628413 of volume 760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:08:42 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.374s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 8 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceedf401-fc7b-4882-888d-4255f5965955]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:42 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e Jul 19 13:08:42 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:43 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e" returned: 0 in 0.680s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:43 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 1G Jul 19 13:08:43 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:44 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 1G" returned: 0 in 0.588s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760a4948-b64a-414e-8794-e01226611f2e -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:44 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760a4948-b64a-414e-8794-e01226611f2e -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 Jul 19 13:08:44 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:44 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760a4948-b64a-414e-8794-e01226611f2e -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413" returned: 0 in 0.388s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:44 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 is being set with open permissions: ugo+rw Jul 19 13:08:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:44 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 Jul 19 13:08:44 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:45 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413" returned: 0 in 0.588s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:45 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.info Jul 19 13:08:45 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:45 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.info" returned: 0 in 0.386s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:45 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.info is being set with open permissions: ugo+rw Jul 19 13:08:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:45 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.info Jul 19 13:08:45 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:46 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.info" returned: 0 in 0.537s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-a4fc0ada-95d4-4745-98e6-bf34707302ff" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-a4fc0ada-95d4-4745-98e6-bf34707302ff" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] snapshot: 86cc1c88-5234-4e97-a0aa-3677a0628413, volume: a4fc0ada-95d4-4745-98e6-bf34707302ff, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[efffa90d-bf7b-495f-8c49-f013f1df1fac]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:46 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 Jul 19 13:08:46 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:46 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413" returned: 0 in 0.490s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760a4948-b64a-414e-8794-e01226611f2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eed2f60-36a5-4192-bf0d-dfc28c125c1d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:46 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e Jul 19 13:08:46 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:47 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e" returned: 0 in 0.517s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:47 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:08:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:47 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff Jul 19 13:08:47 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff" returned: 0 in 7.390s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93af5c68-be98-4a37-bb0f-7428b2a331d3]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:54 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e Jul 19 13:08:54 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:55 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=65,cinder:UPDATE=88,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:08:55 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=85,cinder:SELECT=86,cinder:INSERT=23,cinder:DELETE=10 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:08:55 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e" returned: 0 in 0.952s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:55 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:08:55 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Converted 1024.00 MB image at 138.54 MB/s Jul 19 13:08:55 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff is being set with open permissions: ugo+rw Jul 19 13:08:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:55 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff Jul 19 13:08:55 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:56 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff" returned: 0 in 0.453s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-a4fc0ada-95d4-4745-98e6-bf34707302ff" released by "_copy_volume_from_snapshot" :: held 9.941s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-86cc1c88-5234-4e97-a0aa-3677a0628413" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-86cc1c88-5234-4e97-a0aa-3677a0628413" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Deleting offline snapshot 86cc1c88-5234-4e97-a0aa-3677a0628413 of volume 760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] snapshot_file for this snap is: volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a814b078-3ca6-449c-9c43-5dff9fed5f1b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:56 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 Jul 19 13:08:56 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:56 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413" returned: 0 in 0.508s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760a4948-b64a-414e-8794-e01226611f2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe6424e-df3e-4710-9c4a-e53fa3e0ab08]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:08:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:56 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e Jul 19 13:08:56 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Flow 'volume_create_manager' (73d213ee-966d-4ed4-a5fd-4ae6e36e2f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0659fda-4c1f-4bf8-9e42-b78c9a766abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0659fda-4c1f-4bf8-9e42-b78c9a766abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-73801620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3e8ccf967049b0aa026306d32f0864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:57Z,use_quota=True,user_id='fa66f6af703f491fb2328c02f72d8a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e65f06-ae8d-406d-bf51-8c33584f5af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e65f06-ae8d-406d-bf51-8c33584f5af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c12b3d4-a48c-4bab-b3c5-6f98980000ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c12b3d4-a48c-4bab-b3c5-6f98980000ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff', 'volume_name': 'volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:57 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119589c6-10ba-44cd-a8bc-5b150a2e2582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119589c6-10ba-44cd-a8bc-5b150a2e2582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918fb9b5-3422-43d7-8db3-a977629eb2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Volume b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff', 'volume_size': 1} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e" returned: 0 in 0.670s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:57 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 Jul 19 13:08:57 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:57 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413" returned: 0 in 0.536s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:57 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413 Jul 19 13:08:57 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:58 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e.86cc1c88-5234-4e97-a0aa-3677a0628413" returned: 0 in 0.418s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-86cc1c88-5234-4e97-a0aa-3677a0628413" released by "_delete_snapshot" :: held 2.315s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.751s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-73801620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3e8ccf967049b0aa026306d32f0864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:08:57Z,use_quota=True,user_id='fa66f6af703f491fb2328c02f72d8a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Creating volume b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:08:58 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2522f626-07c5-4c5a-8791-2a1e7d04cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fc0ada-95d4-4745-98e6-bf34707302ff', 'volume_size': 1, 'source_volid': '760a4948-b64a-414e-8794-e01226611f2e', 'source_volstatus': 'available'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:58 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff 1073741824 Jul 19 13:08:58 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f5e15c-4c76-428a-9126-db54e9398a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Volume volume-a4fc0ada-95d4-4745-98e6-bf34707302ff (a4fc0ada-95d4-4745-98e6-bf34707302ff): created successfully Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f5e15c-4c76-428a-9126-db54e9398a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (c8868e6d-2fc7-4c64-854a-d3e9a12cb316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-75344de6-5699-4121-82f6-3814617784ff tempest-VolumesGetTest-1491883992 None] Created volume successfully. Jul 19 13:08:59 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff 1073741824" returned: 0 in 0.613s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:08:59 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff Jul 19 13:08:59 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:08:59 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918fb9b5-3422-43d7-8db3-a977629eb2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0afd969-6cc9-4614-988a-5b3031808fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:08:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Volume volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff (b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff): created successfully Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0afd969-6cc9-4614-988a-5b3031808fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:08:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Flow 'volume_create_manager' (73d213ee-966d-4ed4-a5fd-4ae6e36e2f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:08:59 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a013501c-72e8-4f12-a7df-0f23de59418e tempest-VolumesDeleteCascade-1709095030 None] Created volume successfully. Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (93acf59e-301d-43d0-9164-7452b071538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db41cd2c-2023-4fe6-8a8d-bce0c7546a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db41cd2c-2023-4fe6-8a8d-bce0c7546a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-400479254',display_name='tempest-VolumesGetTest-Volume-1945271343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64beae3e-4784-4b16-b7d6-3668bcc9b7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:00Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26531411-cc4b-451f-baca-68e672bf912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26531411-cc4b-451f-baca-68e672bf912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7129a4-46bf-47bd-8163-7a4b598830cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7129a4-46bf-47bd-8163-7a4b598830cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64beae3e-4784-4b16-b7d6-3668bcc9b7e9', 'volume_name': 'volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6e1f8c-9843-40e9-954a-00de60c04878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6e1f8c-9843-40e9-954a-00de60c04878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab57ce84-8381-4f4f-bb08-8cfeb4e6a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:00 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Volume 64beae3e-4784-4b16-b7d6-3668bcc9b7e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9', 'volume_size': 1} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-400479254',display_name='tempest-VolumesGetTest-Volume-1945271343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64beae3e-4784-4b16-b7d6-3668bcc9b7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:00Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Creating volume 64beae3e-4784-4b16-b7d6-3668bcc9b7e9 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:00 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:00 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 1073741824 Jul 19 13:09:00 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:00 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 1073741824" returned: 0 in 0.692s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:00 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 Jul 19 13:09:00 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:01 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.353s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab57ce84-8381-4f4f-bb08-8cfeb4e6a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8514f6b8-8f59-4c6b-beeb-69fc9b1c2720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Creating offline snapshot b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 of volume b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:09:01 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Volume volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 (64beae3e-4784-4b16-b7d6-3668bcc9b7e9): created successfully Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8514f6b8-8f59-4c6b-beeb-69fc9b1c2720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (93acf59e-301d-43d0-9164-7452b071538f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e159a4be-ca30-454a-aaca-27e71a2e59f8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:01 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cf8a4ebc-21c7-478b-a9a0-c241f0c3e2eb tempest-VolumesGetTest-1491883992 None] Created volume successfully. Jul 19 13:09:01 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff Jul 19 13:09:01 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:01 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" returned: 0 in 0.451s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:01 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 1G Jul 19 13:09:01 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:02 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 1G" returned: 0 in 0.487s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:02 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 Jul 19 13:09:02 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-64beae3e-4784-4b16-b7d6-3668bcc9b7e9-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Lock "cinder-64beae3e-4784-4b16-b7d6-3668bcc9b7e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-64beae3e-4784-4b16-b7d6-3668bcc9b7e9" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-64beae3e-4784-4b16-b7d6-3668bcc9b7e9" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f02851-d781-4191-b300-f14d4f3ea037]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:02 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 Jul 19 13:09:02 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:02 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" returned: 0 in 0.686s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:02 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 is being set with open permissions: ugo+rw Jul 19 13:09:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:02 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 Jul 19 13:09:03 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:03 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9" returned: 0 in 0.872s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:03 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9 Jul 19 13:09:03 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:03 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" returned: 0 in 0.577s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:03 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.info Jul 19 13:09:03 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:03 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.info" returned: 0 in 0.373s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:03 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.info is being set with open permissions: ugo+rw Jul 19 13:09:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:03 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.info Jul 19 13:09:04 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:04 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-64beae3e-4784-4b16-b7d6-3668bcc9b7e9" returned: 0 in 0.812s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-64beae3e-4784-4b16-b7d6-3668bcc9b7e9" released by "delete_volume" :: held 1.779s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Created reservations ['98c377ad-be07-4aeb-a033-2206026bc550', '2fbabbe9-f036-44fe-acf7-1f552a9c0c3f', '3db4adc6-d97d-469e-9907-7da511ae7b2d', 'f03a0d75-6987-407d-b1dd-c73d0eda4405'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:04 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.info" returned: 0 in 0.687s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:04 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:04 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.476s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:04 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1b4980d4-fd21-4feb-ba0f-e9f3d1941816 tempest-VolumesDeleteCascade-1709095030 None] Create snapshot completed successfully Jul 19 13:09:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-a4fc0ada-95d4-4745-98e6-bf34707302ff-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Lock "cinder-a4fc0ada-95d4-4745-98e6-bf34707302ff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-a4fc0ada-95d4-4745-98e6-bf34707302ff" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-a4fc0ada-95d4-4745-98e6-bf34707302ff" acquired by "delete_volume" :: waited 0.064s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90920a8-0bd0-4858-988c-65b2f103aec2]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:05 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.704s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:05 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Deleted volume successfully. Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ba460db-9900-4b96-a70a-da9029b1b356 tempest-VolumesGetTest-1491883992 None] Lock "cinder-64beae3e-4784-4b16-b7d6-3668bcc9b7e9-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:05 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff Jul 19 13:09:05 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Creating offline snapshot 325dd56f-f9e4-43d1-9565-9be6482f51d4 of volume b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ff906-752e-4b1e-97b7-87f1569a98a8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:05 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 Jul 19 13:09:05 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:05 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff" returned: 0 in 0.730s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:06 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff Jul 19 13:09:06 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:06 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a4fc0ada-95d4-4745-98e6-bf34707302ff" returned: 0 in 0.321s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-a4fc0ada-95d4-4745-98e6-bf34707302ff" released by "delete_volume" :: held 1.155s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:06 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" returned: 0 in 0.529s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:06 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 1G Jul 19 13:09:06 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Created reservations ['6269276f-eac9-434e-9536-c73729889f69', '3cd36add-88ca-4af4-9820-cf1419466e09', '85735a62-a7cd-4b10-81a6-f50fde3fb88e', '34c0cfc6-7072-4a16-baab-a3c4c042f0c5'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:06 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:06 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:06 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Deleted volume successfully. Jul 19 13:09:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6bb2c706-a7e5-473b-8093-eccd83f0e182 tempest-VolumesGetTest-1491883992 None] Lock "cinder-a4fc0ada-95d4-4745-98e6-bf34707302ff-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:07 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 1G" returned: 0 in 0.654s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:07 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 Jul 19 13:09:07 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:07 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:07 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 is being set with open permissions: ugo+rw Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:07 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 Jul 19 13:09:07 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-760a4948-b64a-414e-8794-e01226611f2e-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Lock "cinder-760a4948-b64a-414e-8794-e01226611f2e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-760a4948-b64a-414e-8794-e01226611f2e" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-760a4948-b64a-414e-8794-e01226611f2e" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24b5096-b73b-4448-a3f0-1c7bc90edd79]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:07 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e Jul 19 13:09:07 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:07 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4" returned: 0 in 0.532s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-adebeded-ef17-4744-b3ae-c48e408324ee tempest-VolumesDeleteCascade-1709095030 None] Create snapshot completed successfully Jul 19 13:09:08 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:08 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e Jul 19 13:09:08 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:08 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-760a4948-b64a-414e-8794-e01226611f2e" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-760a4948-b64a-414e-8794-e01226611f2e" released by "delete_volume" :: held 0.838s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Created reservations ['8dc1a4b9-fdaa-4837-a946-acc62c7d3519', 'd635b41b-809e-47d4-8b83-11d352e359d1', 'd4447238-f655-4d54-a6cf-ca46d873dce2', '9b82afcf-deb9-4e29-9be9-4a4ca342a5e2'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:08 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:08 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:08 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.347s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Deleted volume successfully. Jul 19 13:09:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b065fe29-d186-4be5-b52a-b5175d47c441 tempest-VolumesGetTest-1491883992 None] Lock "cinder-760a4948-b64a-414e-8794-e01226611f2e-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Performing cascade delete. {{(pid=87305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-325dd56f-f9e4-43d1-9565-9be6482f51d4-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-325dd56f-f9e4-43d1-9565-9be6482f51d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-325dd56f-f9e4-43d1-9565-9be6482f51d4" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-325dd56f-f9e4-43d1-9565-9be6482f51d4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Deleting offline snapshot 325dd56f-f9e4-43d1-9565-9be6482f51d4 of volume b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] snapshot_file for this snap is: volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc9f2d-fefb-4dbb-9823-ccf08115368f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:09 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 Jul 19 13:09:09 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:09 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4" returned: 0 in 0.483s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a87db-b706-48f1-8f02-d86eb91a5049]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:09 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 Jul 19 13:09:09 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (ca13109b-3199-4f6d-9ce1-769cea2f970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:10 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61696cb2-03e1-49ce-9528-57fd168a2e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" returned: 0 in 0.439s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:10 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 Jul 19 13:09:10 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61696cb2-03e1-49ce-9528-57fd168a2e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-907294507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf1aa58-5a66-446c-8224-2dbbd4a8a862,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:10Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16dda52-455c-430d-9520-f00ad17aba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16dda52-455c-430d-9520-f00ad17aba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862723cb-9d89-4bb8-9f58-7a87a4757c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:09:10 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4" returned: 0 in 0.414s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:10 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4 Jul 19 13:09:10 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862723cb-9d89-4bb8-9f58-7a87a4757c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aaf1aa58-5a66-446c-8224-2dbbd4a8a862', 'volume_name': 'volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6941230-852a-4009-baaf-8993bb2f2bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6941230-852a-4009-baaf-8993bb2f2bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5794d667-8a55-4144-8480-71e92b663d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Volume aaf1aa58-5a66-446c-8224-2dbbd4a8a862: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Trying to clone aaf1aa58-5a66-446c-8224-2dbbd4a8a862 from image 97bba3f0-2950-4456-be46-6a90be277718 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:09:10 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.325dd56f-f9e4-43d1-9565-9be6482f51d4" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-325dd56f-f9e4-43d1-9565-9be6482f51d4" released by "_delete_snapshot" :: held 1.730s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" released by "delete_snapshot" :: held 1.755s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Created reservations ['4b030141-3233-4b4a-8289-15f516e2e891', '26d3e59f-1bae-4a10-a08a-efff1c658295', 'e7579110-9cf1-461d-9e8c-ddf65e9887bc', 'cccc587b-7686-4b7e-9a6d-71a5e1080001'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:09:11 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Image download 20.69 MB at 20.69 MB/s Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb1dd4-aaae-4b94-8390-bf012a79f6f8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Delete snapshot completed successfully. Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-325dd56f-f9e4-43d1-9565-9be6482f51d4-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-b3a8e0e6-23a1-42e9-a7bc-77961484ebe5-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-b3a8e0e6-23a1-42e9-a7bc-77961484ebe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:11 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD Jul 19 13:09:11 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Deleting offline snapshot b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 of volume b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] snapshot_file for this snap is: volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a8993-6533-4b30-8a45-75f6869935fb]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:11 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 Jul 19 13:09:11 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:11 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 is fetched for user 2789d899677247c28aea9b88cf749199. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4156d5fd-4cfa-443a-9457-0e8021126853]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:11 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD Jul 19 13:09:11 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:11 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" returned: 0 in 0.440s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[786fd9e7-0365-4641-80bc-be8ec541874b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:11 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff Jul 19 13:09:11 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:11 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-907294507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf1aa58-5a66-446c-8224-2dbbd4a8a862,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:10Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Creating volume aaf1aa58-5a66-446c-8224-2dbbd4a8a862 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:12 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:12 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 1073741824 Jul 19 13:09:12 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:12 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" returned: 0 in 0.436s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:12 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 Jul 19 13:09:12 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:12 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 1073741824" returned: 0 in 0.553s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:12 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 Jul 19 13:09:12 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:12 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" returned: 0 in 0.511s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:12 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5 Jul 19 13:09:12 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:13 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:13 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff.b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" returned: 0 in 0.348s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862" returned: 0 in 0.537s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b3a8e0e6-23a1-42e9-a7bc-77961484ebe5" released by "_delete_snapshot" :: held 1.856s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" released by "delete_snapshot" :: held 1.891s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Attempting download of 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume aaf1aa58-5a66-446c-8224-2dbbd4a8a862. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Created reservations ['25a1e67a-b9b9-4bb8-bf18-880a91ded96f', '21b56c5a-7772-4fb6-95c7-fd841244aff2', 'bf81d54a-3dd3-40ab-b1fe-88bb1e37fdfa', '6fe80f63-9620-4d5b-9754-4d47d43f8efa'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f6ef7-f6dd-4a06-a9d5-7dee4799032f]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_iy19l1by {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Delete snapshot completed successfully. Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-b3a8e0e6-23a1-42e9-a7bc-77961484ebe5-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Snapshots deleted, issuing volume delete {{(pid=87305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f461986-01d7-4a17-bffe-220fda31a734]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:13 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_iy19l1by Jul 19 13:09:13 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:13 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff Jul 19 13:09:13 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:13 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_iy19l1by" returned: 0 in 0.527s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_iy19l1by {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:14 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_iy19l1by Jul 19 13:09:14 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:14 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" returned: 0 in 0.597s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:14 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff Jul 19 13:09:14 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:14 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_iy19l1by" returned: 1 in 0.440s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_iy19l1by' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cab6acd-125a-4d51-b228-6406768e1cdd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:14 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD Jul 19 13:09:14 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:14 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" returned: 0 in 0.329s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff" released by "delete_volume" :: held 1.051s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Created reservations ['35b9e636-088d-4911-aebb-c8387f8b5484', 'aa5b3077-f8c4-41c2-b686-24d0880b748b', '795641c2-33b5-4897-92b8-8a91f0567565', '8a9405da-00d6-4c0b-8578-42df9ecd497b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:14 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] 97bba3f0-2950-4456-be46-6a90be277718 was qcow2, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:14 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 Jul 19 13:09:14 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:14 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:14 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:15 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.267s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:15 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Deleted volume successfully. Jul 19 13:09:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ad8fc1c-58c3-4049-9dc4-015627f469ab tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-b6f94e4d-92ad-4522-a6d7-7ad72d75e3ff-delete_volume" released by "delete_volume" :: held 6.050s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Flow 'volume_create_manager' (36d4e3bc-a1fd-4953-9890-614c62ddec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d18eca8-b0d0-4047-b603-a0dcbb236c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d18eca8-b0d0-4047-b603-a0dcbb236c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-87610726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a289e70-539b-412b-9393-7d2207dd53cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3e8ccf967049b0aa026306d32f0864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:16Z,use_quota=True,user_id='fa66f6af703f491fb2328c02f72d8a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1aac63-de28-422a-b4c6-6c1de6678225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1aac63-de28-422a-b4c6-6c1de6678225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b994913b-81d8-4269-98e3-cd87fd1726b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b994913b-81d8-4269-98e3-cd87fd1726b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a289e70-539b-412b-9393-7d2207dd53cf', 'volume_name': 'volume-2a289e70-539b-412b-9393-7d2207dd53cf', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455cc306-9edf-41eb-98c4-4ee03c814e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455cc306-9edf-41eb-98c4-4ee03c814e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cd9cdf-a639-45a2-9dab-c72b6d13a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:16 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Volume 2a289e70-539b-412b-9393-7d2207dd53cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a289e70-539b-412b-9393-7d2207dd53cf', 'volume_size': 1} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-87610726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a289e70-539b-412b-9393-7d2207dd53cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3e8ccf967049b0aa026306d32f0864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:16Z,use_quota=True,user_id='fa66f6af703f491fb2328c02f72d8a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Creating volume 2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:16 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:16 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf 1073741824 Jul 19 13:09:16 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:16 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862" returned: 0 in 1.957s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_7lp1jkwkdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:09:16 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Converted 112.00 MB image at 57.18 MB/s Jul 19 13:09:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:16 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 1G Jul 19 13:09:16 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:17 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf 1073741824" returned: 0 in 0.458s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:17 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 1G" returned: 0 in 0.369s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Downloaded image 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume aaf1aa58-5a66-446c-8224-2dbbd4a8a862 successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 for user 2789d899677247c28aea9b88cf749199 is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Marking volume aaf1aa58-5a66-446c-8224-2dbbd4a8a862 as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:09:17 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf Jul 19 13:09:17 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Copying metadata from image 97bba3f0-2950-4456-be46-6a90be277718 to aaf1aa58-5a66-446c-8224-2dbbd4a8a862. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Creating volume glance metadata for volume aaf1aa58-5a66-446c-8224-2dbbd4a8a862 backed by image 97bba3f0-2950-4456-be46-6a90be277718 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5794d667-8a55-4144-8480-71e92b663d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7845fd05-c5c4-45c8-ac4a-c457e93672b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:17 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Volume volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 (aaf1aa58-5a66-446c-8224-2dbbd4a8a862): created successfully Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7845fd05-c5c4-45c8-ac4a-c457e93672b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (ca13109b-3199-4f6d-9ce1-769cea2f970f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4ae048b4-e309-4846-8ae7-108b1d8ac778 tempest-VolumesGetTest-1491883992 None] Created volume successfully. Jul 19 13:09:17 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf" returned: 0 in 0.298s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cd9cdf-a639-45a2-9dab-c72b6d13a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a289e70-539b-412b-9393-7d2207dd53cf', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6cb45b-4eb2-4b8a-8d8c-bc69f42e1b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:17 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Volume volume-2a289e70-539b-412b-9393-7d2207dd53cf (2a289e70-539b-412b-9393-7d2207dd53cf): created successfully Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6cb45b-4eb2-4b8a-8d8c-bc69f42e1b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Flow 'volume_create_manager' (36d4e3bc-a1fd-4953-9890-614c62ddec45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5c26bedc-a466-48e3-8224-d2926434f0f5 tempest-VolumesDeleteCascade-1709095030 None] Created volume successfully. Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Flow 'volume_create_manager' (35ac3815-2cc4-4072-b8cd-f911660dbd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22320dc-34ce-4c27-8fad-7c27734e5396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22320dc-34ce-4c27-8fad-7c27734e5396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1351987444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43da0b33-ab91-4450-a3b5-d5f819a55858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7a3e0d0e8440aeb6ec61b9475db3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:18Z,use_quota=True,user_id='15897bf333b54af7a099532c7f6c51ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f873635-f4c1-449d-8c84-8bb724798509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f873635-f4c1-449d-8c84-8bb724798509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbe2ce7-14a4-4ea7-8166-ce55970727e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbe2ce7-14a4-4ea7-8166-ce55970727e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43da0b33-ab91-4450-a3b5-d5f819a55858', 'volume_name': 'volume-43da0b33-ab91-4450-a3b5-d5f819a55858', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c8394b-cd40-4f3a-8421-775f0d99d7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c8394b-cd40-4f3a-8421-775f0d99d7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44da0179-240d-42e1-8bc3-f1e1ff8adc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:17 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Volume 43da0b33-ab91-4450-a3b5-d5f819a55858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43da0b33-ab91-4450-a3b5-d5f819a55858', 'volume_size': 1} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1351987444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43da0b33-ab91-4450-a3b5-d5f819a55858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7a3e0d0e8440aeb6ec61b9475db3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:18Z,use_quota=True,user_id='15897bf333b54af7a099532c7f6c51ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Creating volume 43da0b33-ab91-4450-a3b5-d5f819a55858 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:17 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:17 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 1073741824 Jul 19 13:09:17 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:18 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 1073741824" returned: 0 in 0.474s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:18 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 Jul 19 13:09:18 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (44a3fb37-b7ff-48b5-87be-273718c5035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e55e2f-b9ee-4018-8ab8-f2731d6afd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e55e2f-b9ee-4018-8ab8-f2731d6afd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1865604394',display_name='tempest-VolumesGetTest-Volume-810960698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5d8faf-2748-4ba0-aaa8-04d36073aa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:19Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89081dd5-32b1-43d7-a6dc-bba07e6b319d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89081dd5-32b1-43d7-a6dc-bba07e6b319d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a7bed8-a924-4db5-b19e-af578ac7f20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a7bed8-a924-4db5-b19e-af578ac7f20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5d8faf-2748-4ba0-aaa8-04d36073aa00', 'volume_name': 'volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da44371-fbba-419e-a69f-70a34d00acfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da44371-fbba-419e-a69f-70a34d00acfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c84db9-6ae4-43ab-980a-3fd66907a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Volume ed5d8faf-2748-4ba0-aaa8-04d36073aa00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00', 'volume_size': 1} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:18 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858" returned: 0 in 0.299s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1865604394',display_name='tempest-VolumesGetTest-Volume-810960698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5d8faf-2748-4ba0-aaa8-04d36073aa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5838cd44dd684f24b99aefc47cbdbb48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:19Z,use_quota=True,user_id='2789d899677247c28aea9b88cf749199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Creating volume ed5d8faf-2748-4ba0-aaa8-04d36073aa00 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:18 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44da0179-240d-42e1-8bc3-f1e1ff8adc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43da0b33-ab91-4450-a3b5-d5f819a55858', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:18 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 1073741824 Jul 19 13:09:18 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8766d01e-616a-4136-a8bd-b857753d745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Volume volume-43da0b33-ab91-4450-a3b5-d5f819a55858 (43da0b33-ab91-4450-a3b5-d5f819a55858): created successfully Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8766d01e-616a-4136-a8bd-b857753d745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Flow 'volume_create_manager' (35ac3815-2cc4-4072-b8cd-f911660dbd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-84e64862-d04e-4374-8424-60d7ba8b0969 tempest-AttachVolumeNegativeTest-1076077273 None] Created volume successfully. Jul 19 13:09:19 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 1073741824" returned: 0 in 0.407s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:19 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 Jul 19 13:09:19 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:19 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.746s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c84db9-6ae4-43ab-980a-3fd66907a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ec3804-b17c-48c7-879f-8cf65283fbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Creating offline snapshot 98aabbb1-40c5-4e78-8f4e-caecc3ebe027 of volume 2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:09:19 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Volume volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 (ed5d8faf-2748-4ba0-aaa8-04d36073aa00): created successfully Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ec3804-b17c-48c7-879f-8cf65283fbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Flow 'volume_create_manager' (44a3fb37-b7ff-48b5-87be-273718c5035a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22e07e5-32e9-4c99-bf8d-a86cdcefd12c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:19 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e082766e-ad7c-4f84-a5d8-c3f92734c5af tempest-VolumesGetTest-1491883992 None] Created volume successfully. Jul 19 13:09:19 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf Jul 19 13:09:19 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:19 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf" returned: 0 in 0.388s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:19 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 1G Jul 19 13:09:19 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:20 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 1G" returned: 0 in 0.459s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a289e70-539b-412b-9393-7d2207dd53cf -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:20 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a289e70-539b-412b-9393-7d2207dd53cf -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 Jul 19 13:09:20 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-e7bfa16b-02a8-4fe8-a9a0-21dc68fc8698 req-e36e1ad9-5dcc-4c41-8bd1-7a9087242f37 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:20 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a289e70-539b-412b-9393-7d2207dd53cf -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027" returned: 0 in 0.301s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:20 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 is being set with open permissions: ugo+rw Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:20 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 Jul 19 13:09:20 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-ed5d8faf-2748-4ba0-aaa8-04d36073aa00-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Lock "cinder-ed5d8faf-2748-4ba0-aaa8-04d36073aa00-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-ed5d8faf-2748-4ba0-aaa8-04d36073aa00" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-ed5d8faf-2748-4ba0-aaa8-04d36073aa00" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ed5a53-a8a2-49ac-8e86-937233cca466]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:20 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027" returned: 0 in 0.266s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:20 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.info Jul 19 13:09:20 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:20 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 Jul 19 13:09:20 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:21 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.info" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:21 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.info is being set with open permissions: ugo+rw Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:21 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.info Jul 19 13:09:21 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:21 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:21 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00 Jul 19 13:09:21 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:21 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.info" returned: 0 in 0.255s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-e7bfa16b-02a8-4fe8-a9a0-21dc68fc8698 req-e36e1ad9-5dcc-4c41-8bd1-7a9087242f37 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.957s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:21 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-e7bfa16b-02a8-4fe8-a9a0-21dc68fc8698 req-e36e1ad9-5dcc-4c41-8bd1-7a9087242f37 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed5d8faf-2748-4ba0-aaa8-04d36073aa00" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a8cccd50-d9c0-4b26-9a58-3cf049a84ad5 tempest-VolumesDeleteCascade-1709095030 None] Create snapshot completed successfully Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-ed5d8faf-2748-4ba0-aaa8-04d36073aa00" released by "delete_volume" :: held 0.683s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-e7bfa16b-02a8-4fe8-a9a0-21dc68fc8698 req-e36e1ad9-5dcc-4c41-8bd1-7a9087242f37 tempest-AttachVolumeNegativeTest-1076077273 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-43da0b33-ab91-4450-a3b5-d5f819a55858', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e0d6e9a-5f69-4e3d-924e-4e2ab9dbab29', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:09:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-e7bfa16b-02a8-4fe8-a9a0-21dc68fc8698 req-e36e1ad9-5dcc-4c41-8bd1-7a9087242f37 tempest-AttachVolumeNegativeTest-1076077273 None] attachment_update completed successfully. Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Created reservations ['7e57ca31-522d-486b-a2ce-5c6bdc2f6e48', '9a99a342-dc92-4773-97dc-7f8f722f5bf8', '204205d9-3e0a-4736-bb4b-b7e3515a5df9', '1633c599-6554-42d6-a870-85f975907d41'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:21 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:21 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:22 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-aaf1aa58-5a66-446c-8224-2dbbd4a8a862-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.317s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Deleted volume successfully. Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Lock "cinder-aaf1aa58-5a66-446c-8224-2dbbd4a8a862-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e89044-b410-4875-b142-b4fbcb76e4c7 tempest-VolumesGetTest-1491883992 None] Lock "cinder-ed5d8faf-2748-4ba0-aaa8-04d36073aa00-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Acquiring lock "cinder-quobyte-aaf1aa58-5a66-446c-8224-2dbbd4a8a862" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-aaf1aa58-5a66-446c-8224-2dbbd4a8a862" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a4c541-47b5-4e83-8788-72a0dfa53785]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:22 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 Jul 19 13:09:22 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:22 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862" returned: 0 in 0.431s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Flow 'volume_create_manager' (4d7b08ca-aab4-4f2f-83c3-f5a4252d5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:22 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862 Jul 19 13:09:22 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d54e5a-b205-4eb7-9b4b-f8be1089c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d54e5a-b205-4eb7-9b4b-f8be1089c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-363738613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3404b3da-6725-45f0-93bd-4f67129c8837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3e8ccf967049b0aa026306d32f0864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98aabbb1-40c5-4e78-8f4e-caecc3ebe027,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:23Z,use_quota=True,user_id='fa66f6af703f491fb2328c02f72d8a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8ebeac-0fea-4a5a-9e86-8d0ff5fe3c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8ebeac-0fea-4a5a-9e86-8d0ff5fe3c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd69d185-83c7-47d8-a339-9e8a04e614a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd69d185-83c7-47d8-a339-9e8a04e614a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3404b3da-6725-45f0-93bd-4f67129c8837', 'volume_name': 'volume-3404b3da-6725-45f0-93bd-4f67129c8837', 'volume_size': 1, 'snapshot_id': '98aabbb1-40c5-4e78-8f4e-caecc3ebe027'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0214ba-516e-4c00-8d81-c4090ceca916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0214ba-516e-4c00-8d81-c4090ceca916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea61f6-babc-48f7-8e23-93b872f122b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:22 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Volume 3404b3da-6725-45f0-93bd-4f67129c8837: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3404b3da-6725-45f0-93bd-4f67129c8837', 'volume_size': 1, 'snapshot_id': '98aabbb1-40c5-4e78-8f4e-caecc3ebe027'} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-98aabbb1-40c5-4e78-8f4e-caecc3ebe027-3404b3da-6725-45f0-93bd-4f67129c8837" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-98aabbb1-40c5-4e78-8f4e-caecc3ebe027-3404b3da-6725-45f0-93bd-4f67129c8837" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Creating volume 3404b3da-6725-45f0-93bd-4f67129c8837 from snapshot 98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-3404b3da-6725-45f0-93bd-4f67129c8837" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-3404b3da-6725-45f0-93bd-4f67129c8837" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] snapshot: 98aabbb1-40c5-4e78-8f4e-caecc3ebe027, volume: 3404b3da-6725-45f0-93bd-4f67129c8837, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[373895c5-b50c-4372-b501-e2b7bfc863df]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:22 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-aaf1aa58-5a66-446c-8224-2dbbd4a8a862" returned: 0 in 0.266s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Lock "cinder-quobyte-aaf1aa58-5a66-446c-8224-2dbbd4a8a862" released by "delete_volume" :: held 0.742s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:22 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 Jul 19 13:09:22 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:22 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Created reservations ['562b4296-6fac-4e88-97ef-5b7d56aa2d5a', 'c13b8d3b-f6a0-4673-abe5-a0098d6699d6', 'd8392590-71c6-4239-8c16-9145168d727d', '4a0e18d7-6c60-41b7-85f8-4fdf5506c0dd'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:23 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:23 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:23 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027" returned: 0 in 0.371s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a289e70-539b-412b-9393-7d2207dd53cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e493c453-99ed-45e9-beb8-02193b0dd5f4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:23 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Deleted volume successfully. Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11f89668-1729-488f-856a-64e8add0c143 tempest-VolumesGetTest-1491883992 None] Lock "cinder-aaf1aa58-5a66-446c-8224-2dbbd4a8a862-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:23 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf Jul 19 13:09:23 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:23 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf" returned: 0 in 0.404s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:09:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:23 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 Jul 19 13:09:23 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-ffffe205-7fc9-427c-89c9-292b076d442c req-46caee36-1cb5-4075-a197-83b46f2b365f tempest-AttachVolumeNegativeTest-1076077273 None] Terminate volume connection completed successfully. Jul 19 13:09:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-ffffe205-7fc9-427c-89c9-292b076d442c req-46caee36-1cb5-4075-a197-83b46f2b365f tempest-AttachVolumeNegativeTest-1076077273 None] Deleting attachment 0e0d6e9a-5f69-4e3d-924e-4e2ab9dbab29. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Flow 'volume_create_manager' (5e3be120-30a3-473e-9773-570315dcc76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1b4bd6-39be-4520-a06c-c577397b8b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1b4bd6-39be-4520-a06c-c577397b8b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1391499922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d5ceee-1ed7-4707-94d3-d685fb0a3998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854f6b6c82f549fea0e3ce13e3c17636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:29Z,use_quota=True,user_id='aaed62ef7e2443bfa8c7dfe9cad2e16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a790426-9853-47f3-8d45-f1e7a0137e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a790426-9853-47f3-8d45-f1e7a0137e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652439dc-b323-4a38-8268-006b8d89abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652439dc-b323-4a38-8268-006b8d89abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d5ceee-1ed7-4707-94d3-d685fb0a3998', 'volume_name': 'volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dbfa75-4fcc-42a3-a74a-a444ccc5451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dbfa75-4fcc-42a3-a74a-a444ccc5451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9a0975-2af2-46e9-8e4c-ec67f9b3506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:29 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Volume f9d5ceee-1ed7-4707-94d3-d685fb0a3998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998', 'volume_size': 1} Jul 19 13:09:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:30 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837" returned: 0 in 7.122s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b86916-7600-4766-a59f-df4abc520da9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:30 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf Jul 19 13:09:30 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Flow 'volume_create_manager' (1fe88591-0a2e-49df-a6fb-d4357cb3863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b255825-9a91-42aa-ab0e-74ef9bfc48a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b255825-9a91-42aa-ab0e-74ef9bfc48a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-481040955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a7417f-45ff-454e-b798-9d187d724444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcdb5133c544e78ff519786f24317c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:31Z,use_quota=True,user_id='8f5a0e976bac402ea88228793ff0385b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13525163-f046-4298-a80c-c8664df56bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13525163-f046-4298-a80c-c8664df56bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cdb6f7-7960-4419-8527-c498fef02213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cdb6f7-7960-4419-8527-c498fef02213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a7417f-45ff-454e-b798-9d187d724444', 'volume_name': 'volume-29a7417f-45ff-454e-b798-9d187d724444', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f3c22f-84e4-4adf-b687-fa12a6bb6a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f3c22f-84e4-4adf-b687-fa12a6bb6a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d57d29-2745-4471-bb5f-a23f9bbad401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:31 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Volume 29a7417f-45ff-454e-b798-9d187d724444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a7417f-45ff-454e-b798-9d187d724444', 'volume_size': 1} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:31 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf" returned: 0 in 0.522s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:09:31 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Converted 1024.00 MB image at 143.71 MB/s Jul 19 13:09:31 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 is being set with open permissions: ugo+rw Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:31 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 Jul 19 13:09:31 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:31 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837" returned: 0 in 0.236s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-3404b3da-6725-45f0-93bd-4f67129c8837" released by "_copy_volume_from_snapshot" :: held 8.777s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-98aabbb1-40c5-4e78-8f4e-caecc3ebe027-3404b3da-6725-45f0-93bd-4f67129c8837" released by "_create_volume_from_snapshot" :: held 8.810s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.825s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1391499922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d5ceee-1ed7-4707-94d3-d685fb0a3998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854f6b6c82f549fea0e3ce13e3c17636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:29Z,use_quota=True,user_id='aaed62ef7e2443bfa8c7dfe9cad2e16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Creating volume f9d5ceee-1ed7-4707-94d3-d685fb0a3998 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:31 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:31 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 1073741824 Jul 19 13:09:31 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea61f6-babc-48f7-8e23-93b872f122b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3404b3da-6725-45f0-93bd-4f67129c8837', 'volume_size': 1, 'snapshot_id': '98aabbb1-40c5-4e78-8f4e-caecc3ebe027'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3be29c-616e-4c67-9bec-9512ffdbcafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:31 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Volume volume-3404b3da-6725-45f0-93bd-4f67129c8837 (3404b3da-6725-45f0-93bd-4f67129c8837): created successfully Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3be29c-616e-4c67-9bec-9512ffdbcafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Flow 'volume_create_manager' (4d7b08ca-aab4-4f2f-83c3-f5a4252d5e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:31 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-caff9a09-c799-4f6b-8a7e-9154d845d85c tempest-VolumesDeleteCascade-1709095030 None] Created volume successfully. Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-2a289e70-539b-412b-9393-7d2207dd53cf-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:32 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-2a289e70-539b-412b-9393-7d2207dd53cf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 1073741824" returned: 0 in 0.510s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Performing cascade delete. {{(pid=87305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-98aabbb1-40c5-4e78-8f4e-caecc3ebe027-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:32 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 Jul 19 13:09:32 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-98aabbb1-40c5-4e78-8f4e-caecc3ebe027-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-2a289e70-539b-412b-9393-7d2207dd53cf" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-2a289e70-539b-412b-9393-7d2207dd53cf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-98aabbb1-40c5-4e78-8f4e-caecc3ebe027" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-98aabbb1-40c5-4e78-8f4e-caecc3ebe027" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Deleting offline snapshot 98aabbb1-40c5-4e78-8f4e-caecc3ebe027 of volume 2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] snapshot_file for this snap is: volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef7e3ef-20b5-4fac-9832-9b2f8f258d58]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:32 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 Jul 19 13:09:32 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:32 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998" returned: 0 in 0.264s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-481040955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a7417f-45ff-454e-b798-9d187d724444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcdb5133c544e78ff519786f24317c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:31Z,use_quota=True,user_id='8f5a0e976bac402ea88228793ff0385b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Creating volume 29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:32 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9a0975-2af2-46e9-8e4c-ec67f9b3506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:32 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 1073741824 Jul 19 13:09:32 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d851606-392a-46ad-91f6-b9266a1049a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:32 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Volume volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 (f9d5ceee-1ed7-4707-94d3-d685fb0a3998): created successfully Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d851606-392a-46ad-91f6-b9266a1049a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Flow 'volume_create_manager' (5e3be120-30a3-473e-9773-570315dcc76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-59ea6014-b814-471c-95a1-3afa540dd366 tempest-AttachVolumeTestJSON-1163101209 None] Created volume successfully. Jul 19 13:09:32 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a289e70-539b-412b-9393-7d2207dd53cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7360d8-c903-4883-b6ea-0e9f1b6dd296]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "cinder-43da0b33-ab91-4450-a3b5-d5f819a55858-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-43da0b33-ab91-4450-a3b5-d5f819a55858-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "cinder-quobyte-43da0b33-ab91-4450-a3b5-d5f819a55858" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:32 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf Jul 19 13:09:32 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-quobyte-43da0b33-ab91-4450-a3b5-d5f819a55858" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff6585-943e-494b-86b4-9d5065c3cecc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:33 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 Jul 19 13:09:33 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:33 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 1073741824" returned: 0 in 0.576s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:33 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 Jul 19 13:09:33 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:33 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf" returned: 0 in 0.456s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:33 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 Jul 19 13:09:33 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:33 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858" returned: 0 in 0.408s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:33 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:33 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858 Jul 19 13:09:33 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d57d29-2745-4471-bb5f-a23f9bbad401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a7417f-45ff-454e-b798-9d187d724444', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68f45e5-3eec-4446-811c-0cf63ff25b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:33 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Volume volume-29a7417f-45ff-454e-b798-9d187d724444 (29a7417f-45ff-454e-b798-9d187d724444): created successfully Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68f45e5-3eec-4446-811c-0cf63ff25b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Flow 'volume_create_manager' (1fe88591-0a2e-49df-a6fb-d4357cb3863c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-45d40782-d81e-45df-99af-6e0c20e855c5 tempest-VolumesSnapshotListTestJSON-1385231500 None] Created volume successfully. Jul 19 13:09:33 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027" returned: 0 in 0.338s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:33 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027 Jul 19 13:09:33 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:33 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-43da0b33-ab91-4450-a3b5-d5f819a55858" returned: 0 in 0.275s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-quobyte-43da0b33-ab91-4450-a3b5-d5f819a55858" released by "delete_volume" :: held 0.728s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Created reservations ['b10d5ad7-40ea-4a46-8081-5db03c8dcbf8', 'e6f8ab55-645f-497c-b2cb-a8306a3ed7f2', '3b5b9eee-9a7e-4aa7-ae43-5557765d7377', 'a2943161-633a-4928-bb19-507d8c556aef'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:33 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:33 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:33 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf.98aabbb1-40c5-4e78-8f4e-caecc3ebe027" returned: 0 in 0.289s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-98aabbb1-40c5-4e78-8f4e-caecc3ebe027" released by "_delete_snapshot" :: held 1.569s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-2a289e70-539b-412b-9393-7d2207dd53cf" released by "delete_snapshot" :: held 1.601s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:33 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Created reservations ['c74c82ed-e3bd-434f-a1ad-21244ea48757', 'a655a3cc-2202-4757-95d2-2cd091f23dbb', '60f591f2-4763-4bfc-aec9-a2312a612f4c', 'db05d2ea-5c8c-4419-b253-a7597f6df143'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Delete snapshot completed successfully. Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-98aabbb1-40c5-4e78-8f4e-caecc3ebe027-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Snapshots deleted, issuing volume delete {{(pid=87305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-2a289e70-539b-412b-9393-7d2207dd53cf" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:34 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.306s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-2a289e70-539b-412b-9393-7d2207dd53cf" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Deleted volume successfully. Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a231ab9-599a-47dc-b2b4-b548887d492a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-32dbaaf1-6835-4cc7-af39-46ef4f070e26 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-43da0b33-ab91-4450-a3b5-d5f819a55858-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "cinder-03f3f6a1-ca4e-4833-ae94-4fd4970f0315-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-03f3f6a1-ca4e-4833-ae94-4fd4970f0315-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "cinder-quobyte-03f3f6a1-ca4e-4833-ae94-4fd4970f0315" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-quobyte-03f3f6a1-ca4e-4833-ae94-4fd4970f0315" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:34 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf Jul 19 13:09:34 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16daf72-d5df-497a-b05d-d9918376542a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Creating offline snapshot d8394041-79d1-4343-850c-3a586134984d of volume 29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:09:34 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 Jul 19 13:09:34 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bbfaf8-6624-4380-a462-98b53ba2bd40]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-947b024f-7dd7-49d5-bb97-f60f8701d25f req-50e13917-d2e5-45f1-949f-c03a34d24126 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:34 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf" returned: 0 in 0.499s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:34 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 Jul 19 13:09:34 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:34 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf Jul 19 13:09:34 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:34 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315" returned: 0 in 0.455s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:34 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315 Jul 19 13:09:34 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:34 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2a289e70-539b-412b-9393-7d2207dd53cf" returned: 0 in 0.269s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-2a289e70-539b-412b-9393-7d2207dd53cf" released by "delete_volume" :: held 0.850s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:34 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444" returned: 0 in 0.425s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:34 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d 1G Jul 19 13:09:34 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:34 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Created reservations ['ef2be396-3068-45f4-94c5-28db415ac01e', '545bf433-8ccf-4876-bd47-e55f1141b2ac', '2c189cf6-8e42-40eb-9122-7641de9532fe', '414b6c3e-1d61-4800-88f7-89866779cd08'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:35 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-03f3f6a1-ca4e-4833-ae94-4fd4970f0315" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-quobyte-03f3f6a1-ca4e-4833-ae94-4fd4970f0315" released by "delete_volume" :: held 0.810s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:35 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:35 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Created reservations ['0ef9970a-7943-4e4c-8697-ea6cab1aa7b8', '75dfd60a-a567-4705-89b4-e281c4985706', 'b390c57e-dcfb-4605-aeee-e33af770e5df', '1b2678a1-f174-459e-8c35-b8e7ed2711e4'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:35 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:35 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:35 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Deleted volume successfully. Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d94d2f9d-e05b-44b8-a3ca-16e6d51b3140 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-2a289e70-539b-412b-9393-7d2207dd53cf-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:35 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d 1G" returned: 0 in 0.458s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:35 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d Jul 19 13:09:35 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:35 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Deleted volume successfully. Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-97cf08d7-d18b-4b08-85fa-7c87c141e5f0 tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-03f3f6a1-ca4e-4833-ae94-4fd4970f0315-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-3404b3da-6725-45f0-93bd-4f67129c8837-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-3404b3da-6725-45f0-93bd-4f67129c8837-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "cinder-quobyte-3404b3da-6725-45f0-93bd-4f67129c8837" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-3404b3da-6725-45f0-93bd-4f67129c8837" acquired by "delete_volume" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "cinder-33420328-9d87-4114-9701-561c007c48e5-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98b9fa2-89b0-4f6d-85f1-ab8cbf73a64e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:35 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-33420328-9d87-4114-9701-561c007c48e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d" returned: 0 in 0.379s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:35 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d is being set with open permissions: ugo+rw Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:35 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d Jul 19 13:09:35 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "cinder-quobyte-33420328-9d87-4114-9701-561c007c48e5" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-quobyte-33420328-9d87-4114-9701-561c007c48e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d886cc-b7ac-462f-ab0d-047885cc9635]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:35 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 Jul 19 13:09:35 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:35 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 Jul 19 13:09:35 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:36 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d" returned: 0 in 0.294s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:36 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.info Jul 19 13:09:36 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:36 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837" returned: 0 in 0.401s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:36 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837 Jul 19 13:09:36 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:36 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5" returned: 0 in 0.387s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:36 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5 Jul 19 13:09:36 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:36 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.info" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.info is being set with open permissions: ugo+rw Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:36 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.info Jul 19 13:09:36 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:36 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-3404b3da-6725-45f0-93bd-4f67129c8837" returned: 0 in 0.264s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-quobyte-3404b3da-6725-45f0-93bd-4f67129c8837" released by "delete_volume" :: held 0.720s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Created reservations ['a99bc5c5-12b7-4cb4-adaf-f4d27006c9d5', 'de9b683d-7535-47bf-b707-3b6552d916e1', '232c9afa-e24c-42ed-b18e-e44ef37745a7', '26c8b8c4-57ca-454a-97b4-74ddb7b774a9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:36 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-33420328-9d87-4114-9701-561c007c48e5" returned: 0 in 0.287s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-quobyte-33420328-9d87-4114-9701-561c007c48e5" released by "delete_volume" :: held 0.740s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:36 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:36 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Created reservations ['da394c55-e331-46fa-993a-02648859d441', '63da83bf-586a-427c-ad1f-c09e7ccfe62b', '992aa693-a735-45b9-8736-803d722fcf99', '4ddb7dbd-3eba-49a9-bcf9-f1a1b7eb4548'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:36 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.info" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-947b024f-7dd7-49d5-bb97-f60f8701d25f req-50e13917-d2e5-45f1-949f-c03a34d24126 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.126s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-947b024f-7dd7-49d5-bb97-f60f8701d25f req-50e13917-d2e5-45f1-949f-c03a34d24126 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e7db8738-60eb-41a5-ae59-ceed65e3401b tempest-VolumesSnapshotListTestJSON-1385231500 None] Create snapshot completed successfully Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-947b024f-7dd7-49d5-bb97-f60f8701d25f req-50e13917-d2e5-45f1-949f-c03a34d24126 tempest-AttachVolumeTestJSON-1163101209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bd9c56d-7da8-460a-9fe6-6b12afad6d09', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:09:36 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:36 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:36 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Deleted volume successfully. Jul 19 13:09:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-947b024f-7dd7-49d5-bb97-f60f8701d25f req-50e13917-d2e5-45f1-949f-c03a34d24126 tempest-AttachVolumeTestJSON-1163101209 None] attachment_update completed successfully. Jul 19 13:09:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7615f537-a25f-4f92-a64d-5ffce4aa1200 tempest-VolumesDeleteCascade-1709095030 None] Lock "cinder-3404b3da-6725-45f0-93bd-4f67129c8837-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:37 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.319s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:37 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:37 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Deleted volume successfully. Jul 19 13:09:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46e7a05e-bcff-443f-8ad2-16aef32da60d tempest-AttachVolumeNegativeTest-1076077273 None] Lock "cinder-33420328-9d87-4114-9701-561c007c48e5-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Creating offline snapshot c4a32fb3-e5c9-442e-8f0d-777062282f8c of volume 29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:09:38 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e5a9f6-49b8-41a6-b17a-b43c31fac43a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:38 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d Jul 19 13:09:38 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:38 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d" returned: 0 in 0.455s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a7417f-45ff-454e-b798-9d187d724444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:38 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c 1G Jul 19 13:09:38 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:39 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c 1G" returned: 0 in 0.616s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:39 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c Jul 19 13:09:39 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Flow 'volume_create_manager' (09f4b5ae-da90-4707-9c5a-fcf8bdb9a7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19c9e6a-fcc9-47ad-a3ff-9e3661567a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19c9e6a-fcc9-47ad-a3ff-9e3661567a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-213967625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ebec3-adff-4b68-b2a1-72768e9a8a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854f6b6c82f549fea0e3ce13e3c17636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:39Z,use_quota=True,user_id='aaed62ef7e2443bfa8c7dfe9cad2e16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663279b0-7c80-441f-9903-da43cae9b4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663279b0-7c80-441f-9903-da43cae9b4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5859f394-115e-4e71-a1fb-3f08581fd537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5859f394-115e-4e71-a1fb-3f08581fd537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43ebec3-adff-4b68-b2a1-72768e9a8a29', 'volume_name': 'volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd7e3d9-af54-4ba9-a867-95f5f04a815e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd7e3d9-af54-4ba9-a867-95f5f04a815e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641e3a59-03fc-499e-840c-fac093ee2f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:39 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Volume b43ebec3-adff-4b68-b2a1-72768e9a8a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29', 'volume_size': 1} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:39 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c" returned: 0 in 0.397s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:39 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c is being set with open permissions: ugo+rw Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:39 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c Jul 19 13:09:39 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:39 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c" returned: 0 in 0.272s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-213967625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ebec3-adff-4b68-b2a1-72768e9a8a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854f6b6c82f549fea0e3ce13e3c17636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:39Z,use_quota=True,user_id='aaed62ef7e2443bfa8c7dfe9cad2e16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Creating volume b43ebec3-adff-4b68-b2a1-72768e9a8a29 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:39 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:39 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 1073741824 Jul 19 13:09:39 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:39 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-22361795-f0ce-4d10-b0c8-f3d8b0134012 tempest-VolumesSnapshotListTestJSON-1385231500 None] Create snapshot completed successfully Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:40 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 1073741824" returned: 0 in 0.598s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:40 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 Jul 19 13:09:40 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Flow 'volume_create_manager' (22359b81-b4f9-4253-9d14-608ff4107f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489b06d6-a41b-4c7a-bc47-0bd1fd9cdb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489b06d6-a41b-4c7a-bc47-0bd1fd9cdb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-609812000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bed057-cd7c-4c60-a355-e0d2fed0f1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd486d5c63ef42c18d5c6b75ad83b840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:41Z,use_quota=True,user_id='50be35084cf94659b6a2872d394e1a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4763fbb5-de5f-44fc-8fc5-ce71d5a04fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4763fbb5-de5f-44fc-8fc5-ce71d5a04fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dc5f78-ee1a-4999-b5a6-bb022825d2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dc5f78-ee1a-4999-b5a6-bb022825d2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bed057-cd7c-4c60-a355-e0d2fed0f1f8', 'volume_name': 'volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c637b09-2c3d-4465-8a1c-81bafc85d206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c637b09-2c3d-4465-8a1c-81bafc85d206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d96cb2-71b3-4e27-82e9-289ff9025c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Volume 74bed057-cd7c-4c60-a355-e0d2fed0f1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8', 'volume_size': 1} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:40 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29" returned: 0 in 0.267s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.549s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641e3a59-03fc-499e-840c-fac093ee2f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeea881-bbea-4e17-8021-7e848e477801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Creating offline snapshot f1736f23-62b1-4db1-a66c-fae689dea46e of volume 29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:09:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Volume volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 (b43ebec3-adff-4b68-b2a1-72768e9a8a29): created successfully Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeea881-bbea-4e17-8021-7e848e477801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Flow 'volume_create_manager' (09f4b5ae-da90-4707-9c5a-fcf8bdb9a7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9574df-b1c0-4e37-9793-0bae2c146886]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5292711c-9152-492e-ab9b-d1c7f6fac7df tempest-AttachVolumeTestJSON-1163101209 None] Created volume successfully. Jul 19 13:09:40 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c Jul 19 13:09:40 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:41 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c" returned: 0 in 0.396s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a7417f-45ff-454e-b798-9d187d724444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:41 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e 1G Jul 19 13:09:41 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:41 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e 1G" returned: 0 in 0.586s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:41 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e Jul 19 13:09:41 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:42 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e" returned: 0 in 0.316s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:42 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e is being set with open permissions: ugo+rw Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:42 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e Jul 19 13:09:42 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:42 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:42 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:42 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e" returned: 0 in 0.311s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.753s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.839s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-609812000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bed057-cd7c-4c60-a355-e0d2fed0f1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd486d5c63ef42c18d5c6b75ad83b840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:41Z,use_quota=True,user_id='50be35084cf94659b6a2872d394e1a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Creating volume 74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:42 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:42 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 1073741824 Jul 19 13:09:42 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:42 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-795ef9ab-429d-4a06-848d-d0d75232a877 tempest-VolumesSnapshotListTestJSON-1385231500 None] Create snapshot completed successfully Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-4fca36b8-9232-45ae-89ff-b3ec2393e783 req-01640b84-ec14-4bae-b9dc-d9cb690b8573 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:42 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.313s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:09:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:09:43 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 1073741824" returned: 0 in 0.473s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:43 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 Jul 19 13:09:43 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:43 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-4fca36b8-9232-45ae-89ff-b3ec2393e783 req-01640b84-ec14-4bae-b9dc-d9cb690b8573 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.699s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d96cb2-71b3-4e27-82e9-289ff9025c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd53fb6-8ecb-4a90-8f07-111fe108d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-4fca36b8-9232-45ae-89ff-b3ec2393e783 req-01640b84-ec14-4bae-b9dc-d9cb690b8573 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:43 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Volume volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 (74bed057-cd7c-4c60-a355-e0d2fed0f1f8): created successfully Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd53fb6-8ecb-4a90-8f07-111fe108d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Flow 'volume_create_manager' (22359b81-b4f9-4253-9d14-608ff4107f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-909dfe75-001a-4186-8366-372d5f19ced1 tempest-VolumesCloneTest-1902874369 None] Created volume successfully. Jul 19 13:09:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-4fca36b8-9232-45ae-89ff-b3ec2393e783 req-01640b84-ec14-4bae-b9dc-d9cb690b8573 tempest-AttachVolumeTestJSON-1163101209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61583994-fda7-4a3f-8d78-04b7a017a310', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:09:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-4fca36b8-9232-45ae-89ff-b3ec2393e783 req-01640b84-ec14-4bae-b9dc-d9cb690b8573 tempest-AttachVolumeTestJSON-1163101209 None] attachment_update completed successfully. Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-f1736f23-62b1-4db1-a66c-fae689dea46e-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-f1736f23-62b1-4db1-a66c-fae689dea46e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-quobyte-f1736f23-62b1-4db1-a66c-fae689dea46e" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Flow 'volume_create_manager' (7a2b78fe-8738-45e6-8675-c23730a07f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf194c1-52cc-43f8-a56f-95979002a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-f1736f23-62b1-4db1-a66c-fae689dea46e" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Deleting offline snapshot f1736f23-62b1-4db1-a66c-fae689dea46e of volume 29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] snapshot_file for this snap is: volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf194c1-52cc-43f8-a56f-95979002a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1502572914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0fe2e5-388e-492e-96a1-d96108eb00b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd486d5c63ef42c18d5c6b75ad83b840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=74bed057-cd7c-4c60-a355-e0d2fed0f1f8,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:44Z,use_quota=True,user_id='50be35084cf94659b6a2872d394e1a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc113c9-4c32-46d3-9f96-92a8df149d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc113c9-4c32-46d3-9f96-92a8df149d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b1b811-6df6-48ed-9183-019cc4e31d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfc2e05-402e-4d30-b457-2e61941055ff]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b1b811-6df6-48ed-9183-019cc4e31d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0a0fe2e5-388e-492e-96a1-d96108eb00b2', 'volume_name': 'volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2', 'volume_size': 2, 'source_volid': '74bed057-cd7c-4c60-a355-e0d2fed0f1f8', 'source_volstatus': 'available'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931bce9b-ad07-44ce-9c01-6e248b2137ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931bce9b-ad07-44ce-9c01-6e248b2137ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a91d56-7cab-45bf-b1d4-ab00696bec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:44 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Volume 0a0fe2e5-388e-492e-96a1-d96108eb00b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2', 'volume_size': 2, 'source_volid': '74bed057-cd7c-4c60-a355-e0d2fed0f1f8', 'source_volstatus': 'available'} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:44 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Cloning volume 74bed057-cd7c-4c60-a355-e0d2fed0f1f8 to volume 0a0fe2e5-388e-492e-96a1-d96108eb00b2 Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Creating offline snapshot 28dfe589-eb96-45f2-90d1-41a646421a42 of volume 74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272f19e-4988-4fef-abe4-e03e476bbe08]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:44 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e Jul 19 13:09:44 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:44 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 Jul 19 13:09:44 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Flow 'volume_create_manager' (a96d402e-4440-4067-a99c-cb63eb403861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de7593f-031d-4fee-a54d-175e277b68d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de7593f-031d-4fee-a54d-175e277b68d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-191321855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2009199a-dc9f-45f1-9d75-38b980f8ee91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a1d6d5d1468441d9bb21694e54f9b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:45Z,use_quota=True,user_id='5d9c4b82dc0e4fe18e87e41a9c4f28c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d15a2-046d-4fe7-8c71-c3651171af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d15a2-046d-4fe7-8c71-c3651171af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f48a6-7d6e-4f28-a99f-73c099796f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f48a6-7d6e-4f28-a99f-73c099796f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2009199a-dc9f-45f1-9d75-38b980f8ee91', 'volume_name': 'volume-2009199a-dc9f-45f1-9d75-38b980f8ee91', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b6a7f3-e838-49f3-b9f1-802803ad354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b6a7f3-e838-49f3-b9f1-802803ad354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71553e0f-142b-4f83-a8d2-5f87b6a3650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:45 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Volume 2009199a-dc9f-45f1-9d75-38b980f8ee91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2009199a-dc9f-45f1-9d75-38b980f8ee91', 'volume_size': 1} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:45 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e" returned: 0 in 0.510s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a7417f-45ff-454e-b798-9d187d724444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[719ce6e9-53b5-4180-93ca-6d191836822b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:45 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" returned: 0 in 0.470s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:45 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 1G Jul 19 13:09:45 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:45 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c Jul 19 13:09:45 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-7d65929a-5b94-42d0-a3e8-77482f301b4c req-ae79055e-a26d-493b-96f1-73b954c23c18 tempest-AttachVolumeTestJSON-1163101209 None] Terminate volume connection completed successfully. Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-7d65929a-5b94-42d0-a3e8-77482f301b4c req-ae79055e-a26d-493b-96f1-73b954c23c18 tempest-AttachVolumeTestJSON-1163101209 None] Deleting attachment 6bd9c56d-7da8-460a-9fe6-6b12afad6d09. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:09:45 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c" returned: 0 in 0.393s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a7417f-45ff-454e-b798-9d187d724444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:45 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e Jul 19 13:09:45 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:45 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 1G" returned: 0 in 0.476s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:45 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 Jul 19 13:09:45 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:46 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e" returned: 0 in 0.438s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:46 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42" returned: 0 in 0.325s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:46 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 is being set with open permissions: ugo+rw Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:46 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e Jul 19 13:09:46 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:46 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 Jul 19 13:09:46 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:46 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.f1736f23-62b1-4db1-a66c-fae689dea46e" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:46 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-f1736f23-62b1-4db1-a66c-fae689dea46e" released by "_delete_snapshot" :: held 1.758s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" released by "delete_snapshot" :: held 1.844s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:46 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.info Jul 19 13:09:46 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Created reservations ['a351b775-494d-4069-afca-719bcce9d526', '128bf9d3-1f44-4d02-a34c-e46afea05926', '601270ce-37aa-41bd-86b2-c11c4805ba6f', 'a837ca45-4881-4d43-9972-4675149109da'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Delete snapshot completed successfully. Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2bad4299-30c5-404a-ace2-456890b990ea tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-f1736f23-62b1-4db1-a66c-fae689dea46e-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-c4a32fb3-e5c9-442e-8f0d-777062282f8c-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-c4a32fb3-e5c9-442e-8f0d-777062282f8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-quobyte-c4a32fb3-e5c9-442e-8f0d-777062282f8c" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:46 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.info" returned: 0 in 0.341s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:46 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.info is being set with open permissions: ugo+rw Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-c4a32fb3-e5c9-442e-8f0d-777062282f8c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Deleting offline snapshot c4a32fb3-e5c9-442e-8f0d-777062282f8c of volume 29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:09:46 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.info Jul 19 13:09:46 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] snapshot_file for this snap is: volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1da728-6537-414f-a74b-c970ac237607]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:46 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c Jul 19 13:09:46 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:47 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.info" returned: 0 in 0.261s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "cinder-quobyte-0a0fe2e5-388e-492e-96a1-d96108eb00b2" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-0a0fe2e5-388e-492e-96a1-d96108eb00b2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] snapshot: 28dfe589-eb96-45f2-90d1-41a646421a42, volume: 0a0fe2e5-388e-492e-96a1-d96108eb00b2, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc6ee7d-7fa0-41fd-a5a5-42f55dc0808e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-82f21cb4-3896-401e-a390-66aa930fd296 req-0902c724-735e-4c6b-b79a-4933177f4209 tempest-AttachVolumeTestJSON-1163101209 None] Terminate volume connection completed successfully. Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-82f21cb4-3896-401e-a390-66aa930fd296 req-0902c724-735e-4c6b-b79a-4933177f4209 tempest-AttachVolumeTestJSON-1163101209 None] Deleting attachment 61583994-fda7-4a3f-8d78-04b7a017a310. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:09:47 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a7417f-45ff-454e-b798-9d187d724444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:47 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 Jul 19 13:09:47 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6446a7d-c2a0-4fbd-9ada-e9b17191eec0]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:47 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d Jul 19 13:09:47 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:47 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42" returned: 0 in 0.394s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b411ebe1-4048-4710-b320-d646320debed]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:47 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 Jul 19 13:09:47 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:47 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d" returned: 0 in 0.373s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a7417f-45ff-454e-b798-9d187d724444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:47 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c Jul 19 13:09:47 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:47 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" returned: 0 in 0.391s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:09:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:47 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 Jul 19 13:09:47 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:48 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c" returned: 0 in 0.433s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:48 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c Jul 19 13:09:48 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:48 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.c4a32fb3-e5c9-442e-8f0d-777062282f8c" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-c4a32fb3-e5c9-442e-8f0d-777062282f8c" released by "_delete_snapshot" :: held 1.624s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" released by "delete_snapshot" :: held 1.662s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:48 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Created reservations ['59f0a95d-c734-4067-9e94-fce3576911ad', 'b5e790d7-96c7-4d11-bbe6-e91159bd4042', 'e4e77ee6-e536-4e91-b6cc-1fd1c88cfc5f', '873b890c-986e-4881-bdc5-61b5fb719429'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:48 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Delete snapshot completed successfully. Jul 19 13:09:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc803a0d-40d6-489e-97dc-e06d78da0922 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-c4a32fb3-e5c9-442e-8f0d-777062282f8c-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-d8394041-79d1-4343-850c-3a586134984d-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-d8394041-79d1-4343-850c-3a586134984d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-quobyte-d8394041-79d1-4343-850c-3a586134984d" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-d8394041-79d1-4343-850c-3a586134984d" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Deleting offline snapshot d8394041-79d1-4343-850c-3a586134984d of volume 29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] snapshot_file for this snap is: volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf5c49-7dd4-40da-a3ed-c6ad26532475]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:49 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d Jul 19 13:09:49 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:50 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d" returned: 0 in 0.690s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a7417f-45ff-454e-b798-9d187d724444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:50 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5706066b-15a2-4300-aa92-f05574f4e833]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:50 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 Jul 19 13:09:50 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:51 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444" returned: 0 in 1.233s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:51 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d Jul 19 13:09:51 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:52 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d" returned: 0 in 0.921s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:52 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d Jul 19 13:09:52 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:52 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444.d8394041-79d1-4343-850c-3a586134984d" returned: 0 in 0.550s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-d8394041-79d1-4343-850c-3a586134984d" released by "_delete_snapshot" :: held 3.739s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" released by "delete_snapshot" :: held 3.820s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:53 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Created reservations ['603c6cd2-4ded-4b87-a2f6-4aeadf4c2bb2', 'b27efeda-285c-4987-8250-fadaa19d37a2', '34d2bc46-5214-4283-a671-51cfb793da29', '9cc19416-203c-42a3-aa7c-7312a385aab7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Delete snapshot completed successfully. Jul 19 13:09:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e174fb93-bf62-47b8-aadd-318ed146f32d tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-d8394041-79d1-4343-850c-3a586134984d-delete_snapshot" released by "delete_snapshot" :: held 4.202s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-29a7417f-45ff-454e-b798-9d187d724444-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-29a7417f-45ff-454e-b798-9d187d724444-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ffd946-7b0a-44d4-bc86-26154f112e26]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:54 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2" returned: 0 in 6.228s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d6c042-6f7c-455e-b6a4-f181f5a89768]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:54 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 Jul 19 13:09:54 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:54 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 Jul 19 13:09:54 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:54 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444" returned: 0 in 0.390s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:54 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444 Jul 19 13:09:54 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:54 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" returned: 0 in 0.572s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:09:54 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Converted 1024.00 MB image at 164.39 MB/s Jul 19 13:09:54 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 is being set with open permissions: ugo+rw Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:54 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 Jul 19 13:09:54 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "cinder-b43ebec3-adff-4b68-b2a1-72768e9a8a29-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:54 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-29a7417f-45ff-454e-b798-9d187d724444" returned: 0 in 0.294s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-b43ebec3-adff-4b68-b2a1-72768e9a8a29-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-quobyte-29a7417f-45ff-454e-b798-9d187d724444" released by "delete_volume" :: held 0.793s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "cinder-quobyte-b43ebec3-adff-4b68-b2a1-72768e9a8a29" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-quobyte-b43ebec3-adff-4b68-b2a1-72768e9a8a29" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Created reservations ['e8c2bc54-8f0d-4848-a8a5-6c121dfc1adc', '1eb74907-dbd4-42fb-a704-9f5908278cd2', 'de8ce806-cef3-4dee-96f2-b425426f0483', '651de460-1f3c-48e4-aa14-eb2e4930a4e7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68657251-2d82-48b9-ad02-89e256085463]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:54 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2" returned: 0 in 0.301s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:55 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 Jul 19 13:09:55 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:55 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-0a0fe2e5-388e-492e-96a1-d96108eb00b2" released by "_copy_volume_from_snapshot" :: held 7.998s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:55 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "cinder-quobyte-28dfe589-eb96-45f2-90d1-41a646421a42" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-28dfe589-eb96-45f2-90d1-41a646421a42" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Deleting offline snapshot 28dfe589-eb96-45f2-90d1-41a646421a42 of volume 74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] snapshot_file for this snap is: volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e5e14d-f12c-44b3-a24c-b122280036c1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:55 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 Jul 19 13:09:55 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:55 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.303s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Deleted volume successfully. Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=185,cinder:SELECT=160,cinder:INSERT=48,cinder:DELETE=14 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-772a70e1-c35f-462a-9705-345d58a08b22 tempest-VolumesSnapshotListTestJSON-1385231500 None] Lock "cinder-29a7417f-45ff-454e-b798-9d187d724444-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:55 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29" returned: 0 in 0.469s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:55 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29 Jul 19 13:09:55 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:55 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42" returned: 0 in 0.458s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7cf759-3d9d-487a-9a4f-832ef1bc41da]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:55 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b43ebec3-adff-4b68-b2a1-72768e9a8a29" returned: 0 in 0.288s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-quobyte-b43ebec3-adff-4b68-b2a1-72768e9a8a29" released by "delete_volume" :: held 0.803s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=176,cinder:SELECT=177,cinder:INSERT=53,cinder:DELETE=16 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:09:55 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 Jul 19 13:09:55 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Created reservations ['41879a8d-d335-42ed-a460-8707df9bf8b0', '7b3245d8-b793-4cf3-a041-a36e27351eab', '0af88af7-b151-4a32-8e01-df5e13012fd3', '0cd447e3-48d0-4d20-8a77-57046fe9fe87'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:55 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:55 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "cinder-f9d5ceee-1ed7-4707-94d3-d685fb0a3998-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-f9d5ceee-1ed7-4707-94d3-d685fb0a3998-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "cinder-quobyte-f9d5ceee-1ed7-4707-94d3-d685fb0a3998" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-quobyte-f9d5ceee-1ed7-4707-94d3-d685fb0a3998" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d00f5-9783-4b13-b2e9-b900b88ccbe7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:56 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" returned: 0 in 0.541s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:56 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.334s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:56 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Deleted volume successfully. Jul 19 13:09:56 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 Jul 19 13:09:56 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cbfaa8e6-d898-41a7-96d5-128bf4731585 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-b43ebec3-adff-4b68-b2a1-72768e9a8a29-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:56 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 Jul 19 13:09:56 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:56 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42" returned: 0 in 0.420s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:56 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998" returned: 0 in 0.456s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:56 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42 Jul 19 13:09:56 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:56 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998 Jul 19 13:09:56 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:56 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8.28dfe589-eb96-45f2-90d1-41a646421a42" returned: 0 in 0.292s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:56 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9d5ceee-1ed7-4707-94d3-d685fb0a3998" returned: 0 in 0.299s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-28dfe589-eb96-45f2-90d1-41a646421a42" released by "_delete_snapshot" :: held 1.824s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-quobyte-f9d5ceee-1ed7-4707-94d3-d685fb0a3998" released by "delete_volume" :: held 0.816s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.195s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.822s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-191321855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2009199a-dc9f-45f1-9d75-38b980f8ee91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a1d6d5d1468441d9bb21694e54f9b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:09:45Z,use_quota=True,user_id='5d9c4b82dc0e4fe18e87e41a9c4f28c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Creating volume 2009199a-dc9f-45f1-9d75-38b980f8ee91 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:09:56 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:56 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 1073741824 Jul 19 13:09:56 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a91d56-7cab-45bf-b1d4-ab00696bec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2', 'volume_size': 2, 'source_volid': '74bed057-cd7c-4c60-a355-e0d2fed0f1f8', 'source_volstatus': 'available'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe421f81-b1ce-46de-adaa-25087047b2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Volume volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 (0a0fe2e5-388e-492e-96a1-d96108eb00b2): created successfully Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe421f81-b1ce-46de-adaa-25087047b2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Flow 'volume_create_manager' (7a2b78fe-8738-45e6-8675-c23730a07f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Created reservations ['d491b672-0f8b-4ef7-9116-1dcb3f5a9ac2', 'cf97a433-3084-4580-9416-01a518d87672', '1de52443-bd77-4cf4-9882-51c17eb5b056', 'b419037c-f8b1-4ced-8faa-ef4ff58ffe77'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d7d21c86-935c-4cdf-bd7f-9da3b0564311 tempest-VolumesCloneTest-1902874369 None] Created volume successfully. Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:57 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:57 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "cinder-0b5646eb-1ed8-4856-a38e-23def4696782-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-0b5646eb-1ed8-4856-a38e-23def4696782-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "cinder-quobyte-0b5646eb-1ed8-4856-a38e-23def4696782" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-quobyte-0b5646eb-1ed8-4856-a38e-23def4696782" acquired by "delete_volume" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8da053-ced4-4c94-8482-a2a77a4e24fb]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:57 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.332s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Deleted volume successfully. Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d6d21eed-9e3c-46c7-bb73-6de6137ea607 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-f9d5ceee-1ed7-4707-94d3-d685fb0a3998-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:57 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 1073741824" returned: 0 in 0.594s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:57 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 Jul 19 13:09:57 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:57 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 Jul 19 13:09:57 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "cinder-0a0fe2e5-388e-492e-96a1-d96108eb00b2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:57 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782" returned: 0 in 0.486s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-0a0fe2e5-388e-492e-96a1-d96108eb00b2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:57 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782 Jul 19 13:09:57 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:57 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91" returned: 0 in 0.371s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:09:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71553e0f-142b-4f83-a8d2-5f87b6a3650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2009199a-dc9f-45f1-9d75-38b980f8ee91', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb60151-b4bd-480c-8a25-b57dd6e2f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:09:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Volume volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 (2009199a-dc9f-45f1-9d75-38b980f8ee91): created successfully Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb60151-b4bd-480c-8a25-b57dd6e2f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Flow 'volume_create_manager' (a96d402e-4440-4067-a99c-cb63eb403861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "cinder-quobyte-0a0fe2e5-388e-492e-96a1-d96108eb00b2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-05af588c-6bec-4efc-ad2f-76961a30acb6 req-892745ce-fba5-4072-be24-cbcef90c9695 tempest-VolumesGetTestJSON-828483533 None] Created volume successfully. Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-0a0fe2e5-388e-492e-96a1-d96108eb00b2" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1be36-4cb8-437c-ac6c-0d4c5f60dacd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:58 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0b5646eb-1ed8-4856-a38e-23def4696782" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-quobyte-0b5646eb-1ed8-4856-a38e-23def4696782" released by "delete_volume" :: held 0.859s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:58 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 Jul 19 13:09:58 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Created reservations ['0a31af68-4877-45df-bbba-de34ef82e20d', '9ad4b47f-bf1d-4c8c-acaf-b3655baa7041', 'f31f0a31-a8d3-4db2-8b60-abd902ae6346', 'bc49b9ba-c767-42f1-b5c4-a23b29f9b3be'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:58 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:58 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:58 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2" returned: 0 in 0.451s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:58 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2 Jul 19 13:09:58 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:58 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.438s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Deleted volume successfully. Jul 19 13:09:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bfaf8466-ce29-478e-9847-10177570f8a6 tempest-AttachVolumeTestJSON-1163101209 None] Lock "cinder-0b5646eb-1ed8-4856-a38e-23def4696782-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:59 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a0fe2e5-388e-492e-96a1-d96108eb00b2" returned: 0 in 0.392s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-0a0fe2e5-388e-492e-96a1-d96108eb00b2" released by "delete_volume" :: held 0.906s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Created reservations ['73bf1f0b-a527-413c-b84e-5722b216ebdf', '738e6d3f-787f-4c24-ad4e-a30ce36a4628', 'af8b5fc2-e8c2-475e-84e8-f7374ff63492', '0e3e3f4b-07ee-4165-aeee-4e0af980c631'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:59 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:09:59 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Acquiring lock "cinder-2009199a-dc9f-45f1-9d75-38b980f8ee91-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Lock "cinder-2009199a-dc9f-45f1-9d75-38b980f8ee91-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Acquiring lock "cinder-quobyte-2009199a-dc9f-45f1-9d75-38b980f8ee91" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Lock "cinder-quobyte-2009199a-dc9f-45f1-9d75-38b980f8ee91" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4ffe7-c63e-4322-8d9e-8732f7f79b88]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:09:59 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.411s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:09:59 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Deleted volume successfully. Jul 19 13:09:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4a4a6e65-8d06-4fca-b588-021017c46f44 tempest-VolumesCloneTest-1902874369 None] Lock "cinder-0a0fe2e5-388e-492e-96a1-d96108eb00b2-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:09:59 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 Jul 19 13:09:59 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:00 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91" returned: 0 in 0.463s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:00 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91 Jul 19 13:10:00 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Acquiring lock "cinder-74bed057-cd7c-4c60-a355-e0d2fed0f1f8-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Lock "cinder-74bed057-cd7c-4c60-a355-e0d2fed0f1f8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Acquiring lock "cinder-quobyte-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:00 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2009199a-dc9f-45f1-9d75-38b980f8ee91" returned: 0 in 0.313s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Lock "cinder-quobyte-2009199a-dc9f-45f1-9d75-38b980f8ee91" released by "delete_volume" :: held 0.871s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b157f460-322d-463e-a38b-ba404d1ba841]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.quota [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Created reservations ['1492d602-2eed-4c3a-a574-49ddf301d717', '2d72fa16-3760-44a1-b248-013cd46336f1', '38e76c15-6be2-4b94-977c-fc40f0fc6d64', '44c0510d-bc29-4f58-93b5-3a8ae22a9325'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:00 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 Jul 19 13:10:00 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:00 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:00 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:01 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" returned: 0 in 0.634s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:01 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8 Jul 19 13:10:01 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:01 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.566s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.manager [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:01 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Deleted volume successfully. Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-76cd8b40-c85d-4b9d-88e7-d38fc74a9b77 req-6a93e342-b3aa-4641-bbc3-8659fd5a95e8 tempest-VolumesGetTestJSON-828483533 None] Lock "cinder-2009199a-dc9f-45f1-9d75-38b980f8ee91-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:01 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Lock "cinder-quobyte-74bed057-cd7c-4c60-a355-e0d2fed0f1f8" released by "delete_volume" :: held 1.085s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Created reservations ['4ef5eb24-5141-4913-8e7b-d3d521ab41f9', 'aab0a855-3c98-466b-b0d5-46b875269e97', '046b9990-296c-4627-a51c-4dd424300134', 'dc9756a8-7020-4a9d-9979-98647f777316'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:01 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:01 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:01 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:01 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Deleted volume successfully. Jul 19 13:10:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-509972cc-3b44-447a-815c-567673b51e7f tempest-VolumesCloneTest-1902874369 None] Lock "cinder-74bed057-cd7c-4c60-a355-e0d2fed0f1f8-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:07 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Flow 'volume_create_manager' (bd72a1de-cc0d-4091-8b01-73b8be0312ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a33bf46-5ad7-470d-9c57-5077c4a2044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-478a19c7-ec4a-4641-9611-27764e5fd83a tempest-BackendsCapabilitiesAdminTestsJSON-1914584427 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87305) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 19 13:10:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a33bf46-5ad7-470d-9c57-5077c4a2044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2145455341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d90e75e-1b12-42b3-92c5-f8f563090c57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cf26cf3ffbe4de096990f434a93c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:08Z,use_quota=True,user_id='b7e671732a5d4843af44a5633606b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15394522-bad4-4c07-8c1d-97c90d7f1b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15394522-bad4-4c07-8c1d-97c90d7f1b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a6a44b-0547-4b8a-bb93-b2415b343bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a6a44b-0547-4b8a-bb93-b2415b343bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d90e75e-1b12-42b3-92c5-f8f563090c57', 'volume_name': 'volume-1d90e75e-1b12-42b3-92c5-f8f563090c57', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2606cff-ed0f-4267-9b4a-e8eb1eed35a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2606cff-ed0f-4267-9b4a-e8eb1eed35a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dca9946-f447-4e34-a91d-6f33bbd129b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:08 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Volume 1d90e75e-1b12-42b3-92c5-f8f563090c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d90e75e-1b12-42b3-92c5-f8f563090c57', 'volume_size': 1} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2145455341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d90e75e-1b12-42b3-92c5-f8f563090c57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cf26cf3ffbe4de096990f434a93c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:08Z,use_quota=True,user_id='b7e671732a5d4843af44a5633606b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Creating volume 1d90e75e-1b12-42b3-92c5-f8f563090c57 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:08 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-788adc58-d414-4fdd-b790-331316fc9e80 tempest-BackendsCapabilitiesAdminTestsJSON-1914584427 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87305) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 19 13:10:08 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 1073741824 Jul 19 13:10:08 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:08 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 1073741824" returned: 0 in 0.621s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:08 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 Jul 19 13:10:08 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:09 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57" returned: 0 in 0.337s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dca9946-f447-4e34-a91d-6f33bbd129b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d90e75e-1b12-42b3-92c5-f8f563090c57', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f0429c-4a9a-417b-b550-c0a599f199d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:09 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Volume volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 (1d90e75e-1b12-42b3-92c5-f8f563090c57): created successfully Jul 19 13:10:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f0429c-4a9a-417b-b550-c0a599f199d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Flow 'volume_create_manager' (bd72a1de-cc0d-4091-8b01-73b8be0312ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:09 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2d4812f4-4737-4161-acbc-647db45ff202 tempest-VolumesListTestJSON-1184519651 None] Created volume successfully. Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Flow 'volume_create_manager' (2dff697b-fe5e-46db-9626-9eff6dad1f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb042198-ef7e-401e-bde5-f4b6d8183fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb042198-ef7e-401e-bde5-f4b6d8183fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-553610231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b68b7a-f510-4f1d-80f9-82149f9a0478,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cf26cf3ffbe4de096990f434a93c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:11Z,use_quota=True,user_id='b7e671732a5d4843af44a5633606b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79db52f6-8d6a-4899-80d3-7f0e7cb07c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79db52f6-8d6a-4899-80d3-7f0e7cb07c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b82b302-ff51-4a33-a5ae-bfd5a193d955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b82b302-ff51-4a33-a5ae-bfd5a193d955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b68b7a-f510-4f1d-80f9-82149f9a0478', 'volume_name': 'volume-20b68b7a-f510-4f1d-80f9-82149f9a0478', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b037a1-aec6-4002-8077-cd467ae82350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b037a1-aec6-4002-8077-cd467ae82350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b667561e-b21a-4c36-9dc5-39afb41952d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Volume 20b68b7a-f510-4f1d-80f9-82149f9a0478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b68b7a-f510-4f1d-80f9-82149f9a0478', 'volume_size': 1} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-553610231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b68b7a-f510-4f1d-80f9-82149f9a0478,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cf26cf3ffbe4de096990f434a93c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:11Z,use_quota=True,user_id='b7e671732a5d4843af44a5633606b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Creating volume 20b68b7a-f510-4f1d-80f9-82149f9a0478 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:10 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:10 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 1073741824 Jul 19 13:10:10 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:11 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 1073741824" returned: 0 in 0.601s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:11 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 Jul 19 13:10:11 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:11 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478" returned: 0 in 0.302s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b667561e-b21a-4c36-9dc5-39afb41952d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b68b7a-f510-4f1d-80f9-82149f9a0478', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de34bdae-e212-4e5c-b1b3-35d1358c818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Volume volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 (20b68b7a-f510-4f1d-80f9-82149f9a0478): created successfully Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de34bdae-e212-4e5c-b1b3-35d1358c818f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Flow 'volume_create_manager' (2dff697b-fe5e-46db-9626-9eff6dad1f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e23e3715-6d7c-4fec-95da-26d76235c6b5 tempest-VolumesListTestJSON-1184519651 None] Created volume successfully. Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Flow 'volume_create_manager' (d95722e5-fd97-4f4b-aa41-95818ca09ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b12eb-99dd-4b9f-9e97-55d4248edc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b12eb-99dd-4b9f-9e97-55d4248edc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-335561068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a6a028-276c-45ed-b95f-03f59f84f0c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cf26cf3ffbe4de096990f434a93c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:14Z,use_quota=True,user_id='b7e671732a5d4843af44a5633606b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1745ed12-66ba-4228-aad0-8c02f8080609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1745ed12-66ba-4228-aad0-8c02f8080609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5aa759-a062-4f88-b56c-5a0ae7c0737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5aa759-a062-4f88-b56c-5a0ae7c0737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a6a028-276c-45ed-b95f-03f59f84f0c9', 'volume_name': 'volume-91a6a028-276c-45ed-b95f-03f59f84f0c9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd595d73-650a-4ca1-ab1a-5ad994266ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd595d73-650a-4ca1-ab1a-5ad994266ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26daced-b30d-4820-96dd-b6f4370db258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:13 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Volume 91a6a028-276c-45ed-b95f-03f59f84f0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a6a028-276c-45ed-b95f-03f59f84f0c9', 'volume_size': 1} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-335561068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a6a028-276c-45ed-b95f-03f59f84f0c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7cf26cf3ffbe4de096990f434a93c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:14Z,use_quota=True,user_id='b7e671732a5d4843af44a5633606b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Creating volume 91a6a028-276c-45ed-b95f-03f59f84f0c9 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:13 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:13 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 1073741824 Jul 19 13:10:13 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:14 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 1073741824" returned: 0 in 0.602s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:14 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 Jul 19 13:10:14 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:14 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9" returned: 0 in 0.315s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26daced-b30d-4820-96dd-b6f4370db258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a6a028-276c-45ed-b95f-03f59f84f0c9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d3d271-e8a2-4113-832b-ce83d9d5d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Volume volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 (91a6a028-276c-45ed-b95f-03f59f84f0c9): created successfully Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d3d271-e8a2-4113-832b-ce83d9d5d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Flow 'volume_create_manager' (d95722e5-fd97-4f4b-aa41-95818ca09ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fa515a40-61d0-4c5e-bc6c-00c856ec368e tempest-VolumesListTestJSON-1184519651 None] Created volume successfully. Jul 19 13:10:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e1295835-8f4a-4fcf-bf26-51712888ce11 tempest-GroupSnapshotsTest-1844418931 None] Group tempest-GroupSnapshotsTest-Group-1010342775: creating Jul 19 13:10:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e1295835-8f4a-4fcf-bf26-51712888ce11 tempest-GroupSnapshotsTest-1844418931 None] Group tempest-GroupSnapshotsTest-Group-1010342775: created successfully Jul 19 13:10:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e1295835-8f4a-4fcf-bf26-51712888ce11 tempest-GroupSnapshotsTest-1844418931 None] Create group completed successfully. Jul 19 13:10:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8b2df324-3e17-4d6b-9b39-a019189ede34 tempest-GroupsTest-335977857 None] Group tempest-Group1-1982399155: creating Jul 19 13:10:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8b2df324-3e17-4d6b-9b39-a019189ede34 tempest-GroupsTest-335977857 None] Group tempest-Group1-1982399155: created successfully Jul 19 13:10:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8b2df324-3e17-4d6b-9b39-a019189ede34 tempest-GroupsTest-335977857 None] Create group completed successfully. Jul 19 13:10:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0c404ab8-e228-4896-b3ea-c802b8aab5d7 tempest-GroupsTest-335977857 None] Group tempest-Group2-366870289: creating Jul 19 13:10:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0c404ab8-e228-4896-b3ea-c802b8aab5d7 tempest-GroupsTest-335977857 None] Group tempest-Group2-366870289: created successfully Jul 19 13:10:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0c404ab8-e228-4896-b3ea-c802b8aab5d7 tempest-GroupsTest-335977857 None] Create group completed successfully. Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (438497ec-3d1b-44e8-9454-4d6d4d433a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174019a0-5865-48f5-a34f-f281cd32ceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174019a0-5865-48f5-a34f-f281cd32ceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703797984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4935fce6-d38e-45fa-bae2-a611d23b043c,host='devstack@QuobyteHD#QuobyteHD',id=0293fafc-e794-43f8-ab46-4e50f518aaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:18Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1c5449-1d93-4eae-9489-ea132e36f26f),volume_type_id=4f1c5449-1d93-4eae-9489-ea132e36f26f)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06b501a-6288-4096-a675-e452f39a7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06b501a-6288-4096-a675-e452f39a7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae15d517-de7d-4303-a001-e3295fa8afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae15d517-de7d-4303-a001-e3295fa8afa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0293fafc-e794-43f8-ab46-4e50f518aaa1', 'volume_name': 'volume-0293fafc-e794-43f8-ab46-4e50f518aaa1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798466a5-927e-4c7b-b61a-15791daf1a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798466a5-927e-4c7b-b61a-15791daf1a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111c7007-9964-4079-a88b-0c12e03b4463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Volume 0293fafc-e794-43f8-ab46-4e50f518aaa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0293fafc-e794-43f8-ab46-4e50f518aaa1', 'volume_size': 1} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4935fce6-d38e-45fa-bae2-a611d23b043c,created_at=2026-07-19T11:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703797984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4935fce6-d38e-45fa-bae2-a611d23b043c,host='devstack@QuobyteHD#QuobyteHD',id=0293fafc-e794-43f8-ab46-4e50f518aaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:18Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1c5449-1d93-4eae-9489-ea132e36f26f),volume_type_id=4f1c5449-1d93-4eae-9489-ea132e36f26f)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Creating volume 0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:18 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:18 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 1073741824 Jul 19 13:10:18 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "cinder-91a6a028-276c-45ed-b95f-03f59f84f0c9-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-91a6a028-276c-45ed-b95f-03f59f84f0c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "cinder-quobyte-91a6a028-276c-45ed-b95f-03f59f84f0c9" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-quobyte-91a6a028-276c-45ed-b95f-03f59f84f0c9" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[006f6ddd-1156-4477-becf-a3a68262dda9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:18 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 1073741824" returned: 0 in 0.655s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:18 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 Jul 19 13:10:18 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:18 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 Jul 19 13:10:18 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:19 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9" returned: 0 in 0.602s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:19 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1" returned: 0 in 0.542s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:19 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9 Jul 19 13:10:19 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111c7007-9964-4079-a88b-0c12e03b4463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0293fafc-e794-43f8-ab46-4e50f518aaa1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc63634-abc8-4c91-a348-cf87c3384c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:19 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Volume volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 (0293fafc-e794-43f8-ab46-4e50f518aaa1): created successfully Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc63634-abc8-4c91-a348-cf87c3384c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (438497ec-3d1b-44e8-9454-4d6d4d433a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:19 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b17d7a7d-a74e-4bc8-b340-465c275205f3 tempest-GroupSnapshotsTest-1844418931 None] Created volume successfully. Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Flow 'volume_create_manager' (a3f23986-912f-4edf-94c5-cd363dfd6bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722ac57d-bad9-4e14-bf00-1c995eb344a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722ac57d-bad9-4e14-bf00-1c995eb344a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1068637205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d87529c1-fc6b-4948-a8a9-e4d1efc0e4bd,host='devstack@QuobyteHD#QuobyteHD',id=e1cf248d-2b5d-4263-894b-72ef223ac1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718636e448934fb59d716353bb49a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:20Z,use_quota=True,user_id='176ad404d15d44538a21ca6661a5349b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9262d0b-13c7-42eb-8fa4-4c5c80118556),volume_type_id=b9262d0b-13c7-42eb-8fa4-4c5c80118556)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab21d8e2-345c-4dbd-bd44-e54d8fb1095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab21d8e2-345c-4dbd-bd44-e54d8fb1095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c89dfa-f409-4d58-ad47-a52f41199725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c89dfa-f409-4d58-ad47-a52f41199725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1cf248d-2b5d-4263-894b-72ef223ac1c9', 'volume_name': 'volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dedb63e-7abc-4508-9bb7-93a6d7246ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dedb63e-7abc-4508-9bb7-93a6d7246ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:19 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ae74f1-c45a-466b-97b0-1b74cc7bcedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:19 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Volume e1cf248d-2b5d-4263-894b-72ef223ac1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9', 'volume_size': 1} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d87529c1-fc6b-4948-a8a9-e4d1efc0e4bd,created_at=2026-07-19T11:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1068637205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d87529c1-fc6b-4948-a8a9-e4d1efc0e4bd,host='devstack@QuobyteHD#QuobyteHD',id=e1cf248d-2b5d-4263-894b-72ef223ac1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718636e448934fb59d716353bb49a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:20Z,use_quota=True,user_id='176ad404d15d44538a21ca6661a5349b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9262d0b-13c7-42eb-8fa4-4c5c80118556),volume_type_id=b9262d0b-13c7-42eb-8fa4-4c5c80118556)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Creating volume e1cf248d-2b5d-4263-894b-72ef223ac1c9 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:19 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91a6a028-276c-45ed-b95f-03f59f84f0c9" returned: 0 in 0.523s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:19 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 1073741824 Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-quobyte-91a6a028-276c-45ed-b95f-03f59f84f0c9" released by "delete_volume" :: held 1.200s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:19 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:19 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Created reservations ['a1486d8a-8bbe-4d32-85f1-5acd72c44354', '1a4f1997-6a4c-4a72-a9ea-0c42fb9eada3', 'a134ef20-ea00-41b5-91ee-e360a4e28cb0', 'fd5af006-f253-4482-9560-02fc309dd34c'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:20 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:20 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:20 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.289s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Deleted volume successfully. Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-68591e7f-53ec-412a-ad66-d8743ce1b7fb tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-91a6a028-276c-45ed-b95f-03f59f84f0c9-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:20 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 1073741824" returned: 0 in 0.596s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:20 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 Jul 19 13:10:20 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] GroupSnapshot 91e5302a-6efa-4ec2-bce8-00e745cf4727: creating. Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Group snapshot 91e5302a-6efa-4ec2-bce8-00e745cf4727: creating. {{(pid=87305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:20 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9" returned: 0 in 0.275s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.084s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Creating offline snapshot bdfada81-c351-4ee4-b2e7-5aac8a46857f of volume 0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ae74f1-c45a-466b-97b0-1b74cc7bcedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733f19b8-c0c3-4306-a89f-e65f24d47d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e7b40-2894-4008-b91b-e9f49fb07dd2]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:20 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Volume volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 (e1cf248d-2b5d-4263-894b-72ef223ac1c9): created successfully Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733f19b8-c0c3-4306-a89f-e65f24d47d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Flow 'volume_create_manager' (a3f23986-912f-4edf-94c5-cd363dfd6bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c918849b-be18-418a-9dd7-a5bdadc0c5e7 tempest-GroupsTest-335977857 None] Created volume successfully. Jul 19 13:10:21 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 Jul 19 13:10:21 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "cinder-20b68b7a-f510-4f1d-80f9-82149f9a0478-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-20b68b7a-f510-4f1d-80f9-82149f9a0478-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "cinder-quobyte-20b68b7a-f510-4f1d-80f9-82149f9a0478" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-quobyte-20b68b7a-f510-4f1d-80f9-82149f9a0478" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e95fdea-68ee-405f-812a-89dda59be149]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:21 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 Jul 19 13:10:21 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:21 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1" returned: 0 in 0.459s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:21 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f 1G Jul 19 13:10:21 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:21 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478" returned: 0 in 0.396s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:21 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478 Jul 19 13:10:21 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:21 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f 1G" returned: 0 in 0.457s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:21 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f Jul 19 13:10:21 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:21 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-20b68b7a-f510-4f1d-80f9-82149f9a0478" returned: 0 in 0.323s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-quobyte-20b68b7a-f510-4f1d-80f9-82149f9a0478" released by "delete_volume" :: held 0.771s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Created reservations ['8a8d053d-cb1f-4269-9e06-84e03b596944', '166af69f-54a3-42ed-b2b3-055eda4c58c4', '3ff07adb-e9a1-4ebc-bae3-1f7b38655786', 'e0f9fde2-00b3-4013-98fd-2b3515f344a7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:22 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:22 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:22 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f" returned: 0 in 0.413s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:22 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:22 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f Jul 19 13:10:22 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:22 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "cinder-1d90e75e-1b12-42b3-92c5-f8f563090c57-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.468s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Deleted volume successfully. Jul 19 13:10:22 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-1d90e75e-1b12-42b3-92c5-f8f563090c57-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eeb54b97-1414-4a59-8d1d-8eb400813d48 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-20b68b7a-f510-4f1d-80f9-82149f9a0478-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:22 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.info Jul 19 13:10:22 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "cinder-quobyte-1d90e75e-1b12-42b3-92c5-f8f563090c57" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-quobyte-1d90e75e-1b12-42b3-92c5-f8f563090c57" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b466234e-c0ca-4c77-b0b9-ce84076abb56]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:22 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 Jul 19 13:10:22 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:22 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.info" returned: 0 in 0.323s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:22 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:10:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:22 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.info Jul 19 13:10:22 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Acquiring lock "cinder-quobyte-e1cf248d-2b5d-4263-894b-72ef223ac1c9" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Lock "cinder-quobyte-e1cf248d-2b5d-4263-894b-72ef223ac1c9" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08041fef-ddea-49b4-8378-ba169376d453]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:23 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57" returned: 0 in 0.566s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:23 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57 Jul 19 13:10:23 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:23 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.info" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:23 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 Jul 19 13:10:23 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0a2f68b2-14f2-415b-86bc-42d1818723c6 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 91e5302a-6efa-4ec2-bce8-00e745cf4727: created successfully Jul 19 13:10:23 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1d90e75e-1b12-42b3-92c5-f8f563090c57" returned: 0 in 0.266s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-quobyte-1d90e75e-1b12-42b3-92c5-f8f563090c57" released by "delete_volume" :: held 0.890s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Created reservations ['fd9612ef-455f-4b37-8929-e84d94d5b896', 'aacf39d4-03ac-4949-bf11-3174c73503a7', '34037074-488b-41e9-89d6-aee48fa3b023', '14cdf738-e60d-45a6-9d94-d2b6977a0e06'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:23 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9" returned: 0 in 0.502s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:23 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9 Jul 19 13:10:23 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:23 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:23 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:23 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e1cf248d-2b5d-4263-894b-72ef223ac1c9" returned: 0 in 0.268s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Lock "cinder-quobyte-e1cf248d-2b5d-4263-894b-72ef223ac1c9" released by "delete_volume" :: held 0.839s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:23 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.285s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:23 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Deleted volume successfully. Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Created reservations ['997bce19-1834-4821-81d4-de1f0b2c23a0'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50dbb558-e86a-44b5-a820-b20148138cf4 tempest-VolumesListTestJSON-1184519651 None] Lock "cinder-1d90e75e-1b12-42b3-92c5-f8f563090c57-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:24 devstack cinder-volume[87305]: WARNING cinder.quota [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1881187406 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1881187406, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:10:24 devstack cinder-volume[87305]: WARNING cinder.quota [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1881187406 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1881187406, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Created reservations ['1e40c808-c9f2-48df-a31b-ae2c0dbe6946', '5a12ac53-a5f7-4b74-b8e2-845eac64b326', '934fe0d2-36ec-4d89-8482-d1cb34fdc7a1', '646ab397-0047-46ee-9112-4611ce7ee405'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:24 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:24 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:24 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.371s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Created reservations ['207ac070-c87c-464d-979f-d7baf202af69'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-91c48b0a-37dd-48a6-a4f9-7b3e7dc3ef2a tempest-GroupsTest-335977857 None] Delete group completed successfully. Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:24 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:24 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-bdfada81-c351-4ee4-b2e7-5aac8a46857f-a83e0a32-1ee9-4cfc-8288-06f047c8d874" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-bdfada81-c351-4ee4-b2e7-5aac8a46857f-a83e0a32-1ee9-4cfc-8288-06f047c8d874" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Creating volume a83e0a32-1ee9-4cfc-8288-06f047c8d874 from snapshot bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-a83e0a32-1ee9-4cfc-8288-06f047c8d874" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-a83e0a32-1ee9-4cfc-8288-06f047c8d874" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] snapshot: bdfada81-c351-4ee4-b2e7-5aac8a46857f, volume: a83e0a32-1ee9-4cfc-8288-06f047c8d874, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c666b-4274-435f-9fb5-be966cca811c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:24 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f Jul 19 13:10:24 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:25 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.404s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-72a2608c-9caa-40f9-91a3-b3031f0c5012 tempest-GroupsTest-335977857 None] Delete group completed successfully. Jul 19 13:10:25 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0293fafc-e794-43f8-ab46-4e50f518aaa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bace21-c815-4a25-a922-ee4850e80602]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:25 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 Jul 19 13:10:25 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:25 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1" returned: 0 in 0.533s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:10:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:25 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 Jul 19 13:10:25 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bbcc80c1-492a-4f42-804a-0e0edf07ac52 tempest-GroupsTest-335977857 None] Group tempest-GroupsTest-Group-115419374: creating Jul 19 13:10:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bbcc80c1-492a-4f42-804a-0e0edf07ac52 tempest-GroupsTest-335977857 None] Group tempest-GroupsTest-Group-115419374: created successfully Jul 19 13:10:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bbcc80c1-492a-4f42-804a-0e0edf07ac52 tempest-GroupsTest-335977857 None] Create group completed successfully. Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Flow 'volume_create_manager' (a87d037a-7f39-4d77-98c4-a4ddfa5fb0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa24786-9504-4f41-83bb-790aa794b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa24786-9504-4f41-83bb-790aa794b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279024316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7652fd-e777-4334-a1c2-c3ab7da7fcb7,host='devstack@QuobyteHD#QuobyteHD',id=eb37cdd8-3ea6-457b-aed2-343772d214e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718636e448934fb59d716353bb49a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:29Z,use_quota=True,user_id='176ad404d15d44538a21ca6661a5349b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac1471a-c05e-4f4e-a868-17bed97f2840),volume_type_id=cac1471a-c05e-4f4e-a868-17bed97f2840)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ad54f0-a9f1-4dc0-9f87-a0fdb09da2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ad54f0-a9f1-4dc0-9f87-a0fdb09da2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9bf85f-f108-44f4-b3f2-b7eecc680089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9bf85f-f108-44f4-b3f2-b7eecc680089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb37cdd8-3ea6-457b-aed2-343772d214e5', 'volume_name': 'volume-eb37cdd8-3ea6-457b-aed2-343772d214e5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54a55e0-929b-4bb1-8ee7-21a02cd349d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54a55e0-929b-4bb1-8ee7-21a02cd349d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee441fa-4eb2-4c18-ac13-0ba3030f4edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:29 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Volume eb37cdd8-3ea6-457b-aed2-343772d214e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb37cdd8-3ea6-457b-aed2-343772d214e5', 'volume_size': 1} Jul 19 13:10:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:31 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874" returned: 0 in 6.119s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1163897-d1f0-4759-9b56-ba36730b63e9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:32 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 Jul 19 13:10:32 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:32 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1" returned: 0 in 0.757s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:32 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:10:32 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Converted 1024.00 MB image at 167.32 MB/s Jul 19 13:10:32 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:10:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:32 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 Jul 19 13:10:32 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:33 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874" returned: 0 in 0.527s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-a83e0a32-1ee9-4cfc-8288-06f047c8d874" released by "_copy_volume_from_snapshot" :: held 8.568s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-bdfada81-c351-4ee4-b2e7-5aac8a46857f-a83e0a32-1ee9-4cfc-8288-06f047c8d874" released by "_create_volume_from_snapshot" :: held 8.617s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.645s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7652fd-e777-4334-a1c2-c3ab7da7fcb7,created_at=2026-07-19T11:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279024316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7652fd-e777-4334-a1c2-c3ab7da7fcb7,host='devstack@QuobyteHD#QuobyteHD',id=eb37cdd8-3ea6-457b-aed2-343772d214e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718636e448934fb59d716353bb49a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:29Z,use_quota=True,user_id='176ad404d15d44538a21ca6661a5349b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac1471a-c05e-4f4e-a868-17bed97f2840),volume_type_id=cac1471a-c05e-4f4e-a868-17bed97f2840)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Creating volume eb37cdd8-3ea6-457b-aed2-343772d214e5 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:33 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:33 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 1073741824 Jul 19 13:10:33 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3e63812e-9e80-47aa-a62a-da00c23634d9 tempest-GroupSnapshotsTest-1844418931 None] Create group from source-snapshot-91e5302a-6efa-4ec2-bce8-00e745cf4727 completed successfully. Jul 19 13:10:33 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 1073741824" returned: 0 in 0.593s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:34 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 Jul 19 13:10:34 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:34 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5" returned: 0 in 0.347s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee441fa-4eb2-4c18-ac13-0ba3030f4edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb37cdd8-3ea6-457b-aed2-343772d214e5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713f6f99-d987-43f3-885f-d38069c5cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:34 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Volume volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 (eb37cdd8-3ea6-457b-aed2-343772d214e5): created successfully Jul 19 13:10:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713f6f99-d987-43f3-885f-d38069c5cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Flow 'volume_create_manager' (a87d037a-7f39-4d77-98c4-a4ddfa5fb0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c95fd226-82d5-4cd5-af50-96b9666a3afc tempest-GroupsTest-335977857 None] Created volume successfully. Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-a83e0a32-1ee9-4cfc-8288-06f047c8d874" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-a83e0a32-1ee9-4cfc-8288-06f047c8d874" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6741a1-b60b-4cf7-9c3b-984fb460c5ba]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:35 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 Jul 19 13:10:35 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:35 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874" returned: 0 in 0.493s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:35 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874 Jul 19 13:10:35 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:35 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a83e0a32-1ee9-4cfc-8288-06f047c8d874" returned: 0 in 0.387s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-a83e0a32-1ee9-4cfc-8288-06f047c8d874" released by "delete_volume" :: held 0.938s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['786ab791-4aaa-4ccd-b759-f3fa6be11a67'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:36 devstack cinder-volume[87305]: WARNING cinder.quota [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-478689767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-478689767, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:10:36 devstack cinder-volume[87305]: WARNING cinder.quota [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-478689767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-478689767, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['0f57864a-9c39-429e-ae7b-85261fd5120e', 'a620c525-a10a-4b54-84c8-c587b5d6c768', 'db966427-1477-45d9-a35e-525ffe4e9873', 'caf867d8-8b62-4d0e-9d4b-cb48ab03ab89'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:36 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:36 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:36 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Flow 'volume_create_manager' (03a9e953-88c7-4cb2-9f4c-badb17f0fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c694ec53-f98f-4deb-a594-44d9240ed55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:37 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c694ec53-f98f-4deb-a594-44d9240ed55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306359914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7652fd-e777-4334-a1c2-c3ab7da7fcb7,host='devstack@QuobyteHD#QuobyteHD',id=04964610-457a-4d3e-865e-6837539b65dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718636e448934fb59d716353bb49a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:37Z,use_quota=True,user_id='176ad404d15d44538a21ca6661a5349b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac1471a-c05e-4f4e-a868-17bed97f2840),volume_type_id=cac1471a-c05e-4f4e-a868-17bed97f2840)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05909508-ba70-495c-bbf1-9aebdf4a7188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05909508-ba70-495c-bbf1-9aebdf4a7188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d9261c-44d0-4863-acf5-fa50fc8c692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d9261c-44d0-4863-acf5-fa50fc8c692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04964610-457a-4d3e-865e-6837539b65dc', 'volume_name': 'volume-04964610-457a-4d3e-865e-6837539b65dc', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8b17ac-fdb9-4592-a732-e4ef047ef08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8b17ac-fdb9-4592-a732-e4ef047ef08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5506dd-dfeb-4e85-ad9f-9d6cbff023ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:37 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Volume 04964610-457a-4d3e-865e-6837539b65dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04964610-457a-4d3e-865e-6837539b65dc', 'volume_size': 1} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7652fd-e777-4334-a1c2-c3ab7da7fcb7,created_at=2026-07-19T11:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306359914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7652fd-e777-4334-a1c2-c3ab7da7fcb7,host='devstack@QuobyteHD#QuobyteHD',id=04964610-457a-4d3e-865e-6837539b65dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718636e448934fb59d716353bb49a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:37Z,use_quota=True,user_id='176ad404d15d44538a21ca6661a5349b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac1471a-c05e-4f4e-a868-17bed97f2840),volume_type_id=cac1471a-c05e-4f4e-a868-17bed97f2840)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Creating volume 04964610-457a-4d3e-865e-6837539b65dc {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:37 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.709s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:37 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4dbb9961-09f6-4b6b-970d-3fc5a0bd60ea tempest-GroupSnapshotsTest-1844418931 None] Delete group completed successfully. Jul 19 13:10:37 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc 1073741824 Jul 19 13:10:37 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:37 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 91e5302a-6efa-4ec2-bce8-00e745cf4727: deleting Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 91e5302a-6efa-4ec2-bce8-00e745cf4727: deleting {{(pid=87305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-0293fafc-e794-43f8-ab46-4e50f518aaa1" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-0293fafc-e794-43f8-ab46-4e50f518aaa1" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-bdfada81-c351-4ee4-b2e7-5aac8a46857f" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-bdfada81-c351-4ee4-b2e7-5aac8a46857f" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Deleting offline snapshot bdfada81-c351-4ee4-b2e7-5aac8a46857f of volume 0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] snapshot_file for this snap is: volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:10:37 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc 1073741824" returned: 0 in 0.793s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32455ae1-3f39-473b-8a8a-2bf0e66f613e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:38 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc Jul 19 13:10:38 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:38 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f Jul 19 13:10:38 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:38 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc" returned: 0 in 0.555s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5506dd-dfeb-4e85-ad9f-9d6cbff023ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04964610-457a-4d3e-865e-6837539b65dc', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd964e0-7057-4526-9bdc-d2d455260dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:38 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Volume volume-04964610-457a-4d3e-865e-6837539b65dc (04964610-457a-4d3e-865e-6837539b65dc): created successfully Jul 19 13:10:38 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd964e0-7057-4526-9bdc-d2d455260dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Flow 'volume_create_manager' (03a9e953-88c7-4cb2-9f4c-badb17f0fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f" returned: 0 in 0.731s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0293fafc-e794-43f8-ab46-4e50f518aaa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:10:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-230f7c29-6812-4c2a-9dfa-1218472a1b26 tempest-GroupsTest-335977857 None] Created volume successfully. Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b24e1d-425f-45c9-b399-42affe588846]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:38 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 Jul 19 13:10:38 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:39 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1" returned: 0 in 0.640s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:39 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f Jul 19 13:10:39 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-68fa89cb-2ba8-44d8-b30d-4df0efaed90e tempest-GroupsTest-335977857 None] Update group completed successfully. Jul 19 13:10:40 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f" returned: 0 in 0.852s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:40 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f Jul 19 13:10:40 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:40 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1.bdfada81-c351-4ee4-b2e7-5aac8a46857f" returned: 0 in 0.373s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-bdfada81-c351-4ee4-b2e7-5aac8a46857f" released by "_delete_snapshot" :: held 2.799s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-0293fafc-e794-43f8-ab46-4e50f518aaa1" released by "delete_snapshot" :: held 2.864s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:40 devstack cinder-volume[87305]: WARNING cinder.quota [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-478689767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-478689767, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:10:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['55e1f22c-f7db-4b29-96b2-844bc97a243d', '38cc9898-5071-4b60-a773-689b2f8054fb', '4fd2b00c-b7a6-4586-a06f-ef1afbd58a8c', 'a5f50de3-868b-4b7d-90b7-1cbfe4d309ff'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d9c5df01-afb4-4c8a-b501-0ce7b09b9827 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 91e5302a-6efa-4ec2-bce8-00e745cf4727: deleted successfully Jul 19 13:10:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-04e93928-1b1b-42a6-a8b0-d467951bccd4 tempest-GroupsTest-335977857 None] Update group completed successfully. Jul 19 13:10:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-0293fafc-e794-43f8-ab46-4e50f518aaa1" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-0293fafc-e794-43f8-ab46-4e50f518aaa1" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:41 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33e0091-988f-4aa9-a45c-d333ca6714ea]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:42 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 Jul 19 13:10:42 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Flow 'volume_create_manager' (d4f7d49d-b843-46d2-9949-e837a6c8121d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01e57c8-ef2b-4bd7-b082-a3e7676eec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01e57c8-ef2b-4bd7-b082-a3e7676eec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1665630889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37efccc-164c-4ce5-9adb-e602f91ec62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3517f160c5c74b699d4ee02ff7b225b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:42Z,use_quota=True,user_id='280625f173504047a0ba83b127c15264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6cd0f1-42fa-4263-8714-ee4dc4de6656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6cd0f1-42fa-4263-8714-ee4dc4de6656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166b7a20-3fe3-42da-8848-e881b23c1d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166b7a20-3fe3-42da-8848-e881b23c1d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37efccc-164c-4ce5-9adb-e602f91ec62a', 'volume_name': 'volume-a37efccc-164c-4ce5-9adb-e602f91ec62a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a1a04e-b15e-46fc-bbcc-2028338368fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a1a04e-b15e-46fc-bbcc-2028338368fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ae1961-49a5-4845-b1a6-2cd143fc97ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:42 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Volume a37efccc-164c-4ce5-9adb-e602f91ec62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37efccc-164c-4ce5-9adb-e602f91ec62a', 'volume_size': 1} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1665630889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37efccc-164c-4ce5-9adb-e602f91ec62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3517f160c5c74b699d4ee02ff7b225b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:42Z,use_quota=True,user_id='280625f173504047a0ba83b127c15264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Creating volume a37efccc-164c-4ce5-9adb-e602f91ec62a {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:42 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:42 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a 1073741824 Jul 19 13:10:42 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:42 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:42 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:42 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1" returned: 0 in 0.778s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:42 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1 Jul 19 13:10:42 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:43 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.609s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:10:43 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0293fafc-e794-43f8-ab46-4e50f518aaa1" returned: 0 in 0.552s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-0293fafc-e794-43f8-ab46-4e50f518aaa1" released by "delete_volume" :: held 1.458s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['b11c5042-ea9c-4e3f-8ff2-890dae273761'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Acquiring lock "cinder-quobyte-04964610-457a-4d3e-865e-6837539b65dc" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Lock "cinder-quobyte-04964610-457a-4d3e-865e-6837539b65dc" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:43 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a 1073741824" returned: 0 in 0.981s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e169181-a83b-4ff7-b989-ed555e3062d1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:43 devstack cinder-volume[87305]: WARNING cinder.db.api [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-478689767'] Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['07c705c5-3b76-44a2-9119-af716e5fb5aa', '142128dd-e0a6-46e1-9037-3063b68030d5', '1079592b-659f-44ae-ba6d-c1f7c0f57980', '9f0ab4c0-a2c6-445c-a16e-094e6ffa58a9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:43 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a Jul 19 13:10:43 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:43 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc Jul 19 13:10:43 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:43 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:43 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:43 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a" returned: 0 in 0.458s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ae1961-49a5-4845-b1a6-2cd143fc97ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37efccc-164c-4ce5-9adb-e602f91ec62a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b5a96d-4560-4887-9386-4581070499f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:44 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Volume volume-a37efccc-164c-4ce5-9adb-e602f91ec62a (a37efccc-164c-4ce5-9adb-e602f91ec62a): created successfully Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b5a96d-4560-4887-9386-4581070499f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Flow 'volume_create_manager' (d4f7d49d-b843-46d2-9949-e837a6c8121d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:44 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3297ae9d-68ca-460f-9d1e-db585460ffdf tempest-TestMinimumBasicScenario-134123270 None] Created volume successfully. Jul 19 13:10:44 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc" returned: 0 in 0.790s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:44 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc Jul 19 13:10:44 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:44 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.533s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:44 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a2e06f89-4ed5-448d-aaa3-a79cedc25351 tempest-GroupSnapshotsTest-1844418931 None] Delete group completed successfully. Jul 19 13:10:44 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-04964610-457a-4d3e-865e-6837539b65dc" returned: 0 in 0.319s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Lock "cinder-quobyte-04964610-457a-4d3e-865e-6837539b65dc" released by "delete_volume" :: held 1.242s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Acquiring lock "cinder-quobyte-eb37cdd8-3ea6-457b-aed2-343772d214e5" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Lock "cinder-quobyte-eb37cdd8-3ea6-457b-aed2-343772d214e5" acquired by "delete_volume" :: waited 0.049s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e61cb7c-50db-4846-9f84-3881e4b04b60]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:44 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 Jul 19 13:10:44 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:45 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5" returned: 0 in 0.556s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:45 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5 Jul 19 13:10:45 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-78538f34-bc0d-4685-9685-abf494ef3800 tempest-GroupSnapshotsTest-1844418931 None] Group tempest-GroupSnapshotsTest-Group-4520654: creating Jul 19 13:10:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-78538f34-bc0d-4685-9685-abf494ef3800 tempest-GroupSnapshotsTest-1844418931 None] Group tempest-GroupSnapshotsTest-Group-4520654: created successfully Jul 19 13:10:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-78538f34-bc0d-4685-9685-abf494ef3800 tempest-GroupSnapshotsTest-1844418931 None] Create group completed successfully. Jul 19 13:10:45 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-eb37cdd8-3ea6-457b-aed2-343772d214e5" returned: 0 in 0.432s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Lock "cinder-quobyte-eb37cdd8-3ea6-457b-aed2-343772d214e5" released by "delete_volume" :: held 1.044s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:45 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Created reservations ['623430bf-d294-49a6-839b-f91191f27769'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:45 devstack cinder-volume[87305]: WARNING cinder.quota [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-494874657 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-494874657, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:10:45 devstack cinder-volume[87305]: WARNING cinder.quota [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-494874657 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-494874657, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:10:45 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Created reservations ['92ecb3f3-411a-4e4c-847b-f04670756ecc', '6121308e-2c82-482d-abf8-b0a27ea89414', 'e66a5926-2a62-4553-ac96-6a480b6f4e16', 'c23ca397-259a-4311-af90-87083ed31ad9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Created reservations ['740c70f9-e911-4ae0-9f9d-0701b3d0dec8', '9b3a867f-d0dc-4f74-897f-f31e89dbb083', '82aca19b-2a1e-41dc-8f37-40eb9dc53799', '36506197-7c61-4ad8-931d-ff6d785d6c9a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:46 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:46 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-80ba5c44-8fce-43e6-adf6-c003f917b9a9 req-25d0d9dc-eadf-4886-8531-0a98a9cdd880 tempest-TestMinimumBasicScenario-134123270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-80ba5c44-8fce-43e6-adf6-c003f917b9a9 req-25d0d9dc-eadf-4886-8531-0a98a9cdd880 tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-80ba5c44-8fce-43e6-adf6-c003f917b9a9 req-25d0d9dc-eadf-4886-8531-0a98a9cdd880 tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-80ba5c44-8fce-43e6-adf6-c003f917b9a9 req-25d0d9dc-eadf-4886-8531-0a98a9cdd880 tempest-TestMinimumBasicScenario-134123270 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-a37efccc-164c-4ce5-9adb-e602f91ec62a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7003f195-ddf5-4c20-adfd-8c15568a41c4', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:10:46 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.509s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:46 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ff76a2d6-91ee-44a0-8cc8-1fc2abfbfdc9 tempest-GroupsTest-335977857 None] Delete group completed successfully. Jul 19 13:10:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-80ba5c44-8fce-43e6-adf6-c003f917b9a9 req-25d0d9dc-eadf-4886-8531-0a98a9cdd880 tempest-TestMinimumBasicScenario-134123270 None] attachment_update completed successfully. Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (6a36f4e9-4617-4b80-9096-240cbf9b46aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22483b43-3649-4d46-938e-180da0066b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22483b43-3649-4d46-938e-180da0066b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-962024238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08eddc74-b6f9-44d4-add6-9e568750665f,host='devstack@QuobyteHD#QuobyteHD',id=ffb30e32-addd-438a-8cce-5070b2397a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:48Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f19d16a-4c57-49e8-9a58-cc043b42555b),volume_type_id=7f19d16a-4c57-49e8-9a58-cc043b42555b)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fe8eaf-dd43-423a-9123-9aabebd062d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fe8eaf-dd43-423a-9123-9aabebd062d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e35a48-b246-4edd-aada-d1c717371c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e35a48-b246-4edd-aada-d1c717371c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb30e32-addd-438a-8cce-5070b2397a02', 'volume_name': 'volume-ffb30e32-addd-438a-8cce-5070b2397a02', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa40607-fc59-4a27-9db9-c9fb92bea59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa40607-fc59-4a27-9db9-c9fb92bea59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d3ce4b-dfad-4f5c-a3ae-97b98f653fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:47 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Volume ffb30e32-addd-438a-8cce-5070b2397a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb30e32-addd-438a-8cce-5070b2397a02', 'volume_size': 1} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08eddc74-b6f9-44d4-add6-9e568750665f,created_at=2026-07-19T11:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-962024238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08eddc74-b6f9-44d4-add6-9e568750665f,host='devstack@QuobyteHD#QuobyteHD',id=ffb30e32-addd-438a-8cce-5070b2397a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:48Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f19d16a-4c57-49e8-9a58-cc043b42555b),volume_type_id=7f19d16a-4c57-49e8-9a58-cc043b42555b)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Creating volume ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:48 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:48 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 1073741824 Jul 19 13:10:48 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:48 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 1073741824" returned: 0 in 0.803s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:48 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 Jul 19 13:10:48 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:49 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02" returned: 0 in 0.683s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d3ce4b-dfad-4f5c-a3ae-97b98f653fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb30e32-addd-438a-8cce-5070b2397a02', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17de0764-eacc-4c55-b4fe-389ee8a57eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:49 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Volume volume-ffb30e32-addd-438a-8cce-5070b2397a02 (ffb30e32-addd-438a-8cce-5070b2397a02): created successfully Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17de0764-eacc-4c55-b4fe-389ee8a57eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (6a36f4e9-4617-4b80-9096-240cbf9b46aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:49 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5a809a9a-ec77-4b8b-9cdc-999969d0f295 tempest-GroupSnapshotsTest-1844418931 None] Created volume successfully. Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (418d842a-0981-43e8-9b09-81450757a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efdaa1f-677e-4100-82ef-9b5e498b2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efdaa1f-677e-4100-82ef-9b5e498b2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-963367782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926cb0f1-3918-4f55-b8de-3832012d600e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:50Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26991cd-fc19-440b-a3d4-cfe70349e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26991cd-fc19-440b-a3d4-cfe70349e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e3ca0b-eed8-4c3f-9696-e2cb218eafe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e3ca0b-eed8-4c3f-9696-e2cb218eafe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926cb0f1-3918-4f55-b8de-3832012d600e', 'volume_name': 'volume-926cb0f1-3918-4f55-b8de-3832012d600e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07bf90b-b95f-41f0-ba2d-eada671adbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07bf90b-b95f-41f0-ba2d-eada671adbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5228cf-36a5-49e2-b9cc-f0726ecfc6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:49 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Volume 926cb0f1-3918-4f55-b8de-3832012d600e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926cb0f1-3918-4f55-b8de-3832012d600e', 'volume_size': 1} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-963367782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926cb0f1-3918-4f55-b8de-3832012d600e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:50Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Creating volume 926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:49 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:49 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e 1073741824 Jul 19 13:10:49 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:50 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e 1073741824" returned: 0 in 0.739s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:50 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e Jul 19 13:10:50 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:51 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e" returned: 0 in 0.576s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5228cf-36a5-49e2-b9cc-f0726ecfc6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926cb0f1-3918-4f55-b8de-3832012d600e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7e2072-4cc8-4cbc-bb11-1c1486da44ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:51 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Volume volume-926cb0f1-3918-4f55-b8de-3832012d600e (926cb0f1-3918-4f55-b8de-3832012d600e): created successfully Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7e2072-4cc8-4cbc-bb11-1c1486da44ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (418d842a-0981-43e8-9b09-81450757a862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:51 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1d95abfd-ec8b-4ce5-9c99-4b6c6cdf0ddc tempest-VolumesSnapshotTestJSON-148924655 None] Created volume successfully. Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (d8235905-6175-44a7-9dc7-652ce810f6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f655bbbc-f058-4ba3-9f91-ad42f510036f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f655bbbc-f058-4ba3-9f91-ad42f510036f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336101968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08eddc74-b6f9-44d4-add6-9e568750665f,host='devstack@QuobyteHD#QuobyteHD',id=777fb794-276a-494e-a6c7-9b42e791b228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:52Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f19d16a-4c57-49e8-9a58-cc043b42555b),volume_type_id=7f19d16a-4c57-49e8-9a58-cc043b42555b)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f5bb97-21da-4c0d-9889-6a2344d8987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f5bb97-21da-4c0d-9889-6a2344d8987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed19603-28ea-4571-9261-e8f606a27a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed19603-28ea-4571-9261-e8f606a27a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777fb794-276a-494e-a6c7-9b42e791b228', 'volume_name': 'volume-777fb794-276a-494e-a6c7-9b42e791b228', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4a848b-1f48-478e-b513-880277626685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4a848b-1f48-478e-b513-880277626685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01ca9e-3f82-4d62-ab4a-191271b4e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:51 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Volume 777fb794-276a-494e-a6c7-9b42e791b228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777fb794-276a-494e-a6c7-9b42e791b228', 'volume_size': 1} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08eddc74-b6f9-44d4-add6-9e568750665f,created_at=2026-07-19T11:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336101968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08eddc74-b6f9-44d4-add6-9e568750665f,host='devstack@QuobyteHD#QuobyteHD',id=777fb794-276a-494e-a6c7-9b42e791b228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:52Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f19d16a-4c57-49e8-9a58-cc043b42555b),volume_type_id=7f19d16a-4c57-49e8-9a58-cc043b42555b)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Creating volume 777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:51 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:51 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 1073741824 Jul 19 13:10:51 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:52 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 1073741824" returned: 0 in 0.609s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:52 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 Jul 19 13:10:52 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:52 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228" returned: 0 in 0.264s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.491s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Creating offline snapshot 2c236a00-5420-4b8b-a25b-c88170721f65 of volume 926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01ca9e-3f82-4d62-ab4a-191271b4e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777fb794-276a-494e-a6c7-9b42e791b228', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b62728-df84-499e-b162-bbf44c0a4118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d77ba-6bb2-461c-8ab3-a55e66063aa4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:52 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Volume volume-777fb794-276a-494e-a6c7-9b42e791b228 (777fb794-276a-494e-a6c7-9b42e791b228): created successfully Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b62728-df84-499e-b162-bbf44c0a4118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (d8235905-6175-44a7-9dc7-652ce810f6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:52 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-be26c137-6d9d-4827-b818-fbad9ea51d3e tempest-GroupSnapshotsTest-1844418931 None] Created volume successfully. Jul 19 13:10:52 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e Jul 19 13:10:52 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:53 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e" returned: 0 in 0.448s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:53 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 1G Jul 19 13:10:53 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-51fcef50-1f91-481e-8407-f82c1911b6b9 tempest-GroupSnapshotsTest-1844418931 None] Update group completed successfully. Jul 19 13:10:53 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 1G" returned: 0 in 0.486s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-926cb0f1-3918-4f55-b8de-3832012d600e -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:53 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-926cb0f1-3918-4f55-b8de-3832012d600e -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 Jul 19 13:10:53 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:54 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-926cb0f1-3918-4f55-b8de-3832012d600e -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65" returned: 0 in 0.397s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:54 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 is being set with open permissions: ugo+rw Jul 19 13:10:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:54 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 Jul 19 13:10:54 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:54 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-19dca749-240e-45e5-bf26-c2d4c7f1fb40 tempest-GroupSnapshotsTest-1844418931 None] Update group completed successfully. Jul 19 13:10:54 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.info Jul 19 13:10:54 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:54 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.info" returned: 0 in 0.298s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:54 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.info is being set with open permissions: ugo+rw Jul 19 13:10:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:54 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.info Jul 19 13:10:54 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:55 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.info" returned: 0 in 0.274s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2b19a06e-5c8e-4cee-a57a-f8bab66153bd tempest-VolumesSnapshotTestJSON-148924655 None] Create snapshot completed successfully Jul 19 13:10:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-eac8866f-e82a-482a-be3c-ae5a35190683 tempest-GroupsV320Test-344203469 None] Group tempest-GroupsV320Test-Group-90060476: creating Jul 19 13:10:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-eac8866f-e82a-482a-be3c-ae5a35190683 tempest-GroupsV320Test-344203469 None] Group tempest-GroupsV320Test-Group-90060476: created successfully Jul 19 13:10:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-eac8866f-e82a-482a-be3c-ae5a35190683 tempest-GroupsV320Test-344203469 None] Create group completed successfully. Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=147,cinder:INSERT=38,cinder:UPDATE=196,cinder:DELETE=12 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-2c236a00-5420-4b8b-a25b-c88170721f65-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-2c236a00-5420-4b8b-a25b-c88170721f65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-926cb0f1-3918-4f55-b8de-3832012d600e" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-926cb0f1-3918-4f55-b8de-3832012d600e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-2c236a00-5420-4b8b-a25b-c88170721f65" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:10:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b029dca0-9805-435d-bb6f-5655fd8173cd tempest-GroupSnapshotsTest-1844418931 None] Update group completed successfully. Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-2c236a00-5420-4b8b-a25b-c88170721f65" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Deleting offline snapshot 2c236a00-5420-4b8b-a25b-c88170721f65 of volume 926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] snapshot_file for this snap is: volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60ea47-c98e-44ef-a14d-78cea8c831ef]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:55 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 Jul 19 13:10:55 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:56 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65" returned: 0 in 0.373s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-926cb0f1-3918-4f55-b8de-3832012d600e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:10:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9f7fbb-30cf-44f7-aa8a-6d7f1f2942b6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:56 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e Jul 19 13:10:56 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:56 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e" returned: 0 in 0.393s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:56 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 Jul 19 13:10:56 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:56 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=178,cinder:SELECT=180,cinder:INSERT=42,cinder:DELETE=11 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:10:56 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-595d5595-4c34-456b-948e-aa1e0a6d8de0 tempest-GroupSnapshotsTest-1844418931 None] Update group completed successfully. Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Created reservations ['d1a4d21a-ab87-4257-a0fb-6b433cd55c71'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:57 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65" returned: 0 in 0.542s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:57 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65 Jul 19 13:10:57 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:57 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:10:57 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:57 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e.2c236a00-5420-4b8b-a25b-c88170721f65" returned: 0 in 0.309s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:57 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.291s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-2c236a00-5420-4b8b-a25b-c88170721f65" released by "_delete_snapshot" :: held 1.743s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f635a346-7530-4d25-ae4d-bc53e64aeace tempest-GroupsV320Test-344203469 None] Delete group completed successfully. Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-926cb0f1-3918-4f55-b8de-3832012d600e" released by "delete_snapshot" :: held 1.773s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['86bd37ae-8464-4bf4-8918-07420840a24b', '44311409-bfc3-4cdf-a678-9590d2bdd42a', '97b985db-c768-4aba-a864-93b92f039ae6', 'e1f603dd-e848-4aaf-a05f-79715055236f'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:10:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Delete snapshot completed successfully. Jul 19 13:10:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e094023a-e844-4a73-bf2d-1e73e33a70bd tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-2c236a00-5420-4b8b-a25b-c88170721f65-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (323a7de8-b76e-4fea-9694-33a04f15fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee003da4-99ad-496e-9de7-741264f8512c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee003da4-99ad-496e-9de7-741264f8512c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2082128713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ea8f55-5998-44aa-b1a1-21be613540af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:58Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eee9d0f-2682-4cf8-bac2-f2508db22595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eee9d0f-2682-4cf8-bac2-f2508db22595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3c9ca7-6160-4aaa-bd61-54340f8ba65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3c9ca7-6160-4aaa-bd61-54340f8ba65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ea8f55-5998-44aa-b1a1-21be613540af', 'volume_name': 'volume-c6ea8f55-5998-44aa-b1a1-21be613540af', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e2aa95-c437-478f-a48e-1cacde01e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e2aa95-c437-478f-a48e-1cacde01e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444724fc-0a6b-48d0-ae9c-201e20aefa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Volume c6ea8f55-5998-44aa-b1a1-21be613540af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ea8f55-5998-44aa-b1a1-21be613540af', 'volume_size': 1} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2082128713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ea8f55-5998-44aa-b1a1-21be613540af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:10:58Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Creating volume c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:10:58 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] GroupSnapshot 324a5134-d128-40f9-924a-7be0110c6e73: creating. Jul 19 13:10:58 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af 1073741824 Jul 19 13:10:58 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Group snapshot 324a5134-d128-40f9-924a-7be0110c6e73: creating. {{(pid=87305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:10:58 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af 1073741824" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:58 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af Jul 19 13:10:58 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:59 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.712s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444724fc-0a6b-48d0-ae9c-201e20aefa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ea8f55-5998-44aa-b1a1-21be613540af', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8facbda-cc96-437b-a78a-ff5fb73d615a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Creating offline snapshot 2ffb4614-44b0-41c8-b838-2d542e5d7882 of volume ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:10:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Volume volume-c6ea8f55-5998-44aa-b1a1-21be613540af (c6ea8f55-5998-44aa-b1a1-21be613540af): created successfully Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8facbda-cc96-437b-a78a-ff5fb73d615a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (323a7de8-b76e-4fea-9694-33a04f15fbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6032734e-fe14-43b2-bc09-8dba7a4f7181]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:59 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-af4734d2-f503-44ed-9b6c-24784fe238af tempest-VolumesSnapshotTestJSON-148924655 None] Created volume successfully. Jul 19 13:10:59 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 Jul 19 13:10:59 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:10:59 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02" returned: 0 in 0.466s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:10:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:10:59 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 1G Jul 19 13:10:59 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:00 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 1G" returned: 0 in 0.493s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb30e32-addd-438a-8cce-5070b2397a02 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:00 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb30e32-addd-438a-8cce-5070b2397a02 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 Jul 19 13:11:00 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:00 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb30e32-addd-438a-8cce-5070b2397a02 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882" returned: 0 in 0.439s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:00 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:11:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:00 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 Jul 19 13:11:00 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:00 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:01 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.info Jul 19 13:11:01 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:01 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.info" returned: 0 in 0.289s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:01 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:01 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.info Jul 19 13:11:01 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:01 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.info" returned: 0 in 0.283s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Creating offline snapshot 7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a of volume 777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3639d2-329a-43c6-948d-c068bbf45283]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:01 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 Jul 19 13:11:01 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:02 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228" returned: 0 in 0.419s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:02 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a 1G Jul 19 13:11:02 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:02 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a 1G" returned: 0 in 0.537s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777fb794-276a-494e-a6c7-9b42e791b228 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:02 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777fb794-276a-494e-a6c7-9b42e791b228 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a Jul 19 13:11:02 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:02 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777fb794-276a-494e-a6c7-9b42e791b228 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" returned: 0 in 0.334s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:02 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:11:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:02 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a Jul 19 13:11:02 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:03 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:03 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.info Jul 19 13:11:03 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:03 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.info" returned: 0 in 0.261s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:03 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:03 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.info Jul 19 13:11:03 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:03 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.info" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.181s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Creating offline snapshot deb59c31-d59c-49d4-a7b4-1f5a2ada5563 of volume c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fac4d14-8d9d-4a20-a370-63e00cddeba5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f0365c47-ceff-4d2c-9bc3-1835230d7b97 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 324a5134-d128-40f9-924a-7be0110c6e73: created successfully Jul 19 13:11:03 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af Jul 19 13:11:03 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:04 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:04 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 1G Jul 19 13:11:04 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:04 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 1G" returned: 0 in 0.414s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ea8f55-5998-44aa-b1a1-21be613540af -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:04 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ea8f55-5998-44aa-b1a1-21be613540af -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 Jul 19 13:11:04 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:05 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ea8f55-5998-44aa-b1a1-21be613540af -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:05 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 is being set with open permissions: ugo+rw Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:05 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 Jul 19 13:11:05 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:05 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 324a5134-d128-40f9-924a-7be0110c6e73: deleting Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 324a5134-d128-40f9-924a-7be0110c6e73: deleting {{(pid=87305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-ffb30e32-addd-438a-8cce-5070b2397a02" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-ffb30e32-addd-438a-8cce-5070b2397a02" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-2ffb4614-44b0-41c8-b838-2d542e5d7882" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-2ffb4614-44b0-41c8-b838-2d542e5d7882" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Deleting offline snapshot 2ffb4614-44b0-41c8-b838-2d542e5d7882 of volume ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:11:05 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] snapshot_file for this snap is: volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563" returned: 0 in 0.339s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16343d56-10e4-4a18-b226-847ad02e8319]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:05 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.info Jul 19 13:11:05 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:05 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 Jul 19 13:11:05 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:05 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.info" returned: 0 in 0.319s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:05 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.info is being set with open permissions: ugo+rw Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:05 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.info Jul 19 13:11:05 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:05 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882" returned: 0 in 0.456s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffb30e32-addd-438a-8cce-5070b2397a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[107a8383-e98b-4be4-ba2c-3d01a3d0eaa0]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:05 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 Jul 19 13:11:05 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:06 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.info" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3e0168bd-5f1d-423e-8c81-98d81e098863 tempest-VolumesSnapshotTestJSON-148924655 None] Create snapshot completed successfully Jul 19 13:11:06 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02" returned: 0 in 0.412s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:06 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 Jul 19 13:11:06 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:06 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882" returned: 0 in 0.452s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:06 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882 Jul 19 13:11:06 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:07 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02.2ffb4614-44b0-41c8-b838-2d542e5d7882" returned: 0 in 0.360s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-2ffb4614-44b0-41c8-b838-2d542e5d7882" released by "_delete_snapshot" :: held 1.808s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-ffb30e32-addd-438a-8cce-5070b2397a02" released by "delete_snapshot" :: held 1.835s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-777fb794-276a-494e-a6c7-9b42e791b228" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-777fb794-276a-494e-a6c7-9b42e791b228" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Deleting offline snapshot 7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a of volume 777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] snapshot_file for this snap is: volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58668c15-11e1-4c9d-a073-ea12ae76f658]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:07 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a Jul 19 13:11:07 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:07 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" returned: 0 in 0.714s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-777fb794-276a-494e-a6c7-9b42e791b228(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e1d80-0ff7-423b-82bf-eca7835e3cd4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (b77cf78b-f3cf-4f39-955e-86510257e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea632337-b4f8-4522-bd50-d06f36fa22af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea632337-b4f8-4522-bd50-d06f36fa22af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-765163674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bff82f-d725-4af6-a906-778f746c8cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=deb59c31-d59c-49d4-a7b4-1f5a2ada5563,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:08Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80da6a6-3f34-4f78-adab-b1d8f052c2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80da6a6-3f34-4f78-adab-b1d8f052c2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3723f496-cedb-4f00-882f-cdf9b4336609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3723f496-cedb-4f00-882f-cdf9b4336609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18bff82f-d725-4af6-a906-778f746c8cf2', 'volume_name': 'volume-18bff82f-d725-4af6-a906-778f746c8cf2', 'volume_size': 2, 'snapshot_id': 'deb59c31-d59c-49d4-a7b4-1f5a2ada5563'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471d3a16-98bd-466a-8c36-ca7a017e7969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471d3a16-98bd-466a-8c36-ca7a017e7969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6887f4fa-d386-48e7-b3b9-c5edaac79d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:08 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Volume 18bff82f-d725-4af6-a906-778f746c8cf2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18bff82f-d725-4af6-a906-778f746c8cf2', 'volume_size': 2, 'snapshot_id': 'deb59c31-d59c-49d4-a7b4-1f5a2ada5563'} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-deb59c31-d59c-49d4-a7b4-1f5a2ada5563-18bff82f-d725-4af6-a906-778f746c8cf2" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:08 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 Jul 19 13:11:08 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-deb59c31-d59c-49d4-a7b4-1f5a2ada5563-18bff82f-d725-4af6-a906-778f746c8cf2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Creating volume 18bff82f-d725-4af6-a906-778f746c8cf2 from snapshot deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-18bff82f-d725-4af6-a906-778f746c8cf2" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-18bff82f-d725-4af6-a906-778f746c8cf2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] snapshot: deb59c31-d59c-49d4-a7b4-1f5a2ada5563, volume: 18bff82f-d725-4af6-a906-778f746c8cf2, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a171a1-d954-4a29-922a-bd9e89d679c7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:08 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 Jul 19 13:11:08 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:08 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228" returned: 0 in 0.491s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:08 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a Jul 19 13:11:08 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:08 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563" returned: 0 in 0.531s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ea8f55-5998-44aa-b1a1-21be613540af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2b4ab3-5b3d-4429-9ca6-da3613951d65]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:08 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af Jul 19 13:11:08 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:09 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" returned: 0 in 0.575s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:09 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a Jul 19 13:11:09 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:09 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af" returned: 0 in 0.530s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:09 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 Jul 19 13:11:09 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:09 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228.7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" returned: 0 in 0.369s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-7cfbc811-70e8-4a55-b2b1-c1a2b07d3e0a" released by "_delete_snapshot" :: held 2.331s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-777fb794-276a-494e-a6c7-9b42e791b228" released by "delete_snapshot" :: held 2.369s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:09 devstack cinder-volume[87305]: WARNING cinder.quota [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-245549348 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-245549348, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:11:09 devstack cinder-volume[87305]: WARNING cinder.quota [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-245549348 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-245549348, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['c73b8894-7779-4676-aa30-ec937619d842', 'bb38c29f-0fc0-4504-af0a-fb1e4f6de353', '354ebc8c-2f3b-4b5b-834e-c9ec53f6a2a5', 'f5e0a567-eb3f-40ac-a668-787834fbcf3e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:09 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['2d90daa4-22f6-4fa8-ade2-c0229576b51c', '4ea0e4a2-575d-43be-b7b1-9dd6d12635ea', '80a69a52-58b5-4724-8050-7e6dd63371a1', 'cc1eab20-5c33-40a8-a731-a2dff45ca575'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:10 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1c8209c9-dc20-425c-8e6e-75a5c2ff8de7 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot 324a5134-d128-40f9-924a-7be0110c6e73: deleted successfully Jul 19 13:11:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-777fb794-276a-494e-a6c7-9b42e791b228" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-777fb794-276a-494e-a6c7-9b42e791b228" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:12 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e9af7-ef83-4c07-a5b9-ac710940b522]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:12 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 Jul 19 13:11:12 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:13 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228" returned: 0 in 1.286s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:13 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228 Jul 19 13:11:13 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:14 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-777fb794-276a-494e-a6c7-9b42e791b228" returned: 0 in 0.962s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-777fb794-276a-494e-a6c7-9b42e791b228" released by "delete_volume" :: held 2.452s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-ffb30e32-addd-438a-8cce-5070b2397a02" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-ffb30e32-addd-438a-8cce-5070b2397a02" acquired by "delete_volume" :: waited 0.058s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:14 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a944e6d1-ad1d-4963-9e3e-b2401bb6b6a8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:15 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 Jul 19 13:11:15 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:15 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02" returned: 0 in 0.849s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:15 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02 Jul 19 13:11:15 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:16 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ffb30e32-addd-438a-8cce-5070b2397a02" returned: 0 in 0.896s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-ffb30e32-addd-438a-8cce-5070b2397a02" released by "delete_volume" :: held 1.939s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:16 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2" returned: 0 in 7.287s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b90ce9-6471-48e6-92f3-39a8713838c9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:16 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['0ff504b6-78b6-47ff-ae93-ab0c05eaeea6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:16 devstack cinder-volume[87305]: WARNING cinder.quota [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-245549348 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-245549348, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:11:16 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af Jul 19 13:11:16 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:16 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['9cae1ef3-4a11-4af6-992e-2c77c1792481', '7bf9fd2f-0a69-4f50-8be7-01629aec9ed7', 'f793b531-721a-4c93-a1ac-7f2c05a36a83', '7ba2eaa3-6044-4558-965d-355bb9a06a12'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['ce8eb681-3569-4c52-bdd3-5ad6bdaa28b0', '233e7314-70c4-4f5d-a550-f3144f297ba8', '8547bcb5-58e2-4dd1-aa38-10e1113c0347', '88cdf3e6-fbb6-417d-9f22-0f1b609f58dd'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:17 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:17 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:17 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af" returned: 0 in 1.045s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:11:17 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Converted 1024.00 MB image at 140.50 MB/s Jul 19 13:11:17 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 is being set with open permissions: ugo+rw Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:17 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.292s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:17 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-46ca4b8b-b690-4c5f-ab12-31628a9370ed tempest-GroupSnapshotsTest-1844418931 None] Delete group completed successfully. Jul 19 13:11:17 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 Jul 19 13:11:17 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:18 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2" returned: 0 in 0.313s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-18bff82f-d725-4af6-a906-778f746c8cf2" released by "_copy_volume_from_snapshot" :: held 9.821s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-deb59c31-d59c-49d4-a7b4-1f5a2ada5563-18bff82f-d725-4af6-a906-778f746c8cf2" released by "_create_volume_from_snapshot" :: held 9.858s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.877s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6887f4fa-d386-48e7-b3b9-c5edaac79d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bff82f-d725-4af6-a906-778f746c8cf2', 'volume_size': 2, 'snapshot_id': 'deb59c31-d59c-49d4-a7b4-1f5a2ada5563'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293aa61f-516b-4f73-8f87-5ee05896b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Volume volume-18bff82f-d725-4af6-a906-778f746c8cf2 (18bff82f-d725-4af6-a906-778f746c8cf2): created successfully Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293aa61f-516b-4f73-8f87-5ee05896b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (b77cf78b-f3cf-4f39-955e-86510257e49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a9dc113f-c314-4483-ac64-1d3f0d4814a1 tempest-VolumesSnapshotTestJSON-148924655 None] Created volume successfully. Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-18bff82f-d725-4af6-a906-778f746c8cf2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-18bff82f-d725-4af6-a906-778f746c8cf2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-18bff82f-d725-4af6-a906-778f746c8cf2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-18bff82f-d725-4af6-a906-778f746c8cf2" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9561104-113d-4e38-a90b-3a9674496725]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:18 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 Jul 19 13:11:18 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-af7a120e-56f0-4ad4-81e2-1dbf8e767f12 tempest-GroupSnapshotsTest-1844418931 None] Group tempest-GroupSnapshotsTest-Group-393104666: creating Jul 19 13:11:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-af7a120e-56f0-4ad4-81e2-1dbf8e767f12 tempest-GroupSnapshotsTest-1844418931 None] Group tempest-GroupSnapshotsTest-Group-393104666: created successfully Jul 19 13:11:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-af7a120e-56f0-4ad4-81e2-1dbf8e767f12 tempest-GroupSnapshotsTest-1844418931 None] Create group completed successfully. Jul 19 13:11:19 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2" returned: 0 in 0.554s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:19 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2 Jul 19 13:11:19 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:19 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-18bff82f-d725-4af6-a906-778f746c8cf2" returned: 0 in 0.274s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-18bff82f-d725-4af6-a906-778f746c8cf2" released by "delete_volume" :: held 0.886s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['f33d212f-f03e-4ffb-8783-9282bdd736d3', '42fd5e6f-c348-4a2e-882a-e608381d8e59', '095db673-cdf2-49dd-919e-12e3591de61e', 'ff3f9acc-1e7f-49a5-bb64-b83183d851e6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:19 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:19 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-deb59c31-d59c-49d4-a7b4-1f5a2ada5563-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-deb59c31-d59c-49d4-a7b4-1f5a2ada5563-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-c6ea8f55-5998-44aa-b1a1-21be613540af" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-c6ea8f55-5998-44aa-b1a1-21be613540af" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-deb59c31-d59c-49d4-a7b4-1f5a2ada5563" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-deb59c31-d59c-49d4-a7b4-1f5a2ada5563" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Deleting offline snapshot deb59c31-d59c-49d4-a7b4-1f5a2ada5563 of volume c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:11:20 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] snapshot_file for this snap is: volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.355s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6233f-50e2-419c-af4c-442a862a4212]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Deleted volume successfully. Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3f243919-9b79-4d62-b722-26d306028813 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-18bff82f-d725-4af6-a906-778f746c8cf2-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:20 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 Jul 19 13:11:20 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:20 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563" returned: 0 in 0.428s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ea8f55-5998-44aa-b1a1-21be613540af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c12eb-53f6-41d4-a0fa-6137e949debf]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:20 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af Jul 19 13:11:20 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (a841e882-1fbb-4580-b780-8b6352c2b7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517e382b-357e-48ab-b044-e74176d85746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517e382b-357e-48ab-b044-e74176d85746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-895650539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da4bf45b-6340-4397-8c0e-aa4ade3dfd1e,host='devstack@QuobyteHD#QuobyteHD',id=739833c8-db2c-48ed-88b2-32ec0331b201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:21Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(724d0ea3-136b-460b-8ee7-e4c29722e8b3),volume_type_id=724d0ea3-136b-460b-8ee7-e4c29722e8b3)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81398d80-e27d-4427-ab17-2a7bb71f0fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81398d80-e27d-4427-ab17-2a7bb71f0fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff763041-86f5-4583-9073-6014178e92bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff763041-86f5-4583-9073-6014178e92bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739833c8-db2c-48ed-88b2-32ec0331b201', 'volume_name': 'volume-739833c8-db2c-48ed-88b2-32ec0331b201', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb83122-76f4-4bf4-9966-2519940373c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb83122-76f4-4bf4-9966-2519940373c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd8ba55-c76a-4fc5-9b6d-5da995231040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:20 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Volume 739833c8-db2c-48ed-88b2-32ec0331b201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739833c8-db2c-48ed-88b2-32ec0331b201', 'volume_size': 1} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da4bf45b-6340-4397-8c0e-aa4ade3dfd1e,created_at=2026-07-19T11:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-895650539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da4bf45b-6340-4397-8c0e-aa4ade3dfd1e,host='devstack@QuobyteHD#QuobyteHD',id=739833c8-db2c-48ed-88b2-32ec0331b201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b7378a8096414991919b1ee7cda2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:21Z,use_quota=True,user_id='64a12220b95e43a2b283028aa46e6363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(724d0ea3-136b-460b-8ee7-e4c29722e8b3),volume_type_id=724d0ea3-136b-460b-8ee7-e4c29722e8b3)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Creating volume 739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:21 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:21 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 1073741824 Jul 19 13:11:21 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:21 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af" returned: 0 in 0.562s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:21 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 Jul 19 13:11:21 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:21 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563" returned: 0 in 0.419s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:21 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563 Jul 19 13:11:21 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:21 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 1073741824" returned: 0 in 0.545s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:21 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 Jul 19 13:11:21 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:21 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af.deb59c31-d59c-49d4-a7b4-1f5a2ada5563" returned: 0 in 0.260s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-deb59c31-d59c-49d4-a7b4-1f5a2ada5563" released by "_delete_snapshot" :: held 1.828s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-c6ea8f55-5998-44aa-b1a1-21be613540af" released by "delete_snapshot" :: held 1.881s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:21 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201" returned: 0 in 0.274s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd8ba55-c76a-4fc5-9b6d-5da995231040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739833c8-db2c-48ed-88b2-32ec0331b201', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784196b7-6b19-425e-a96b-3cc726b8b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['4f01be84-2397-4e52-8df4-7f17cf5e3000', 'b62d7f56-3145-4b63-b47a-bcfa19ad068c', 'e26dcb33-fe4d-4909-96a6-9872e6c069f5', '6845a0e7-1e21-48a8-ad6e-791af0805577'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:21 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Volume volume-739833c8-db2c-48ed-88b2-32ec0331b201 (739833c8-db2c-48ed-88b2-32ec0331b201): created successfully Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784196b7-6b19-425e-a96b-3cc726b8b581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Flow 'volume_create_manager' (a841e882-1fbb-4580-b780-8b6352c2b7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-93b6b7aa-dd40-41dc-8db3-a0c58e473075 tempest-GroupSnapshotsTest-1844418931 None] Created volume successfully. Jul 19 13:11:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Delete snapshot completed successfully. Jul 19 13:11:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b20c0668-b1e8-495e-9680-58c843bbd004 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-deb59c31-d59c-49d4-a7b4-1f5a2ada5563-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-c6ea8f55-5998-44aa-b1a1-21be613540af-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-c6ea8f55-5998-44aa-b1a1-21be613540af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-c6ea8f55-5998-44aa-b1a1-21be613540af" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-c6ea8f55-5998-44aa-b1a1-21be613540af" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] GroupSnapshot e57937d3-34b3-46b0-a9c6-8219dc9cf14b: creating. Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c02d98c-ef0c-4806-b23d-fa53cd0dd4e5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Group snapshot e57937d3-34b3-46b0-a9c6-8219dc9cf14b: creating. {{(pid=87305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Creating offline snapshot 18464fef-2ce0-444d-b762-d21d044b8328 of volume 739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b2352-6735-45f1-b925-5b8af347171d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:22 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af Jul 19 13:11:22 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:22 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 Jul 19 13:11:22 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:22 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:22 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:22 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af Jul 19 13:11:22 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:22 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 1G Jul 19 13:11:22 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:23 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c6ea8f55-5998-44aa-b1a1-21be613540af" returned: 0 in 0.255s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-c6ea8f55-5998-44aa-b1a1-21be613540af" released by "delete_volume" :: held 0.758s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['56f0eff5-2079-4047-bbde-b1d393dd94bd', '225c06b5-5c60-47b3-9542-a7055b134d96', 'd8fa9ee9-0010-4115-bf99-f85b435a71cc', 'fc08da9f-5335-449f-815e-98dea480930a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:23 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:23 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:23 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 1G" returned: 0 in 0.515s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739833c8-db2c-48ed-88b2-32ec0331b201 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:23 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739833c8-db2c-48ed-88b2-32ec0331b201 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 Jul 19 13:11:23 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:23 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Deleted volume successfully. Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b449d34-f382-4868-8219-53818806ab1b tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-c6ea8f55-5998-44aa-b1a1-21be613540af-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:23 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-739833c8-db2c-48ed-88b2-32ec0331b201 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328" returned: 0 in 0.369s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:23 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:23 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 Jul 19 13:11:23 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:23 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328" returned: 0 in 0.314s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:24 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.info Jul 19 13:11:24 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (851dbdc4-6566-434f-b011-8703dbb91ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9866ec9-adeb-47a3-9d6c-9587bc965a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9866ec9-adeb-47a3-9d6c-9587bc965a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-437622949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9855fc-29de-4aae-8e30-193060e46c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:24Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6e5d73-ffab-4dfb-9e5a-7c1ef6ce0035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6e5d73-ffab-4dfb-9e5a-7c1ef6ce0035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707ffbaf-7382-4ec0-9f19-1e9a746bb255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707ffbaf-7382-4ec0-9f19-1e9a746bb255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9855fc-29de-4aae-8e30-193060e46c52', 'volume_name': 'volume-1f9855fc-29de-4aae-8e30-193060e46c52', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912873c9-43f3-4821-ac8c-68d05cc35b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912873c9-43f3-4821-ac8c-68d05cc35b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d843e7-7c61-4767-bc7b-dfcceae5f398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Volume 1f9855fc-29de-4aae-8e30-193060e46c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9855fc-29de-4aae-8e30-193060e46c52', 'volume_size': 1} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Flow 'volume_create_manager' (666ae190-cf7d-4420-8f3a-e369beb65bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6912fe7-936d-4a3f-9344-b1d2dc5908f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6912fe7-936d-4a3f-9344-b1d2dc5908f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-412792782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42314d6d-f689-4ab0-851c-2c842749f091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85deb6129964213a91a98f31a7eefd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:24Z,use_quota=True,user_id='f744a0f41475491cad4ebb2b5939ccd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e53da46-58cc-4201-ab60-3a6efbab2e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e53da46-58cc-4201-ab60-3a6efbab2e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a62305-f32a-486f-be18-331cbba4de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a62305-f32a-486f-be18-331cbba4de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42314d6d-f689-4ab0-851c-2c842749f091', 'volume_name': 'volume-42314d6d-f689-4ab0-851c-2c842749f091', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ae5600-ad00-46ca-82db-dade11e4b09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ae5600-ad00-46ca-82db-dade11e4b09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e978be3-37ef-49c5-95c7-49edb6302cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:24 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Volume 42314d6d-f689-4ab0-851c-2c842749f091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42314d6d-f689-4ab0-851c-2c842749f091', 'volume_size': 1} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.info" returned: 0 in 0.299s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:24 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:24 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.info Jul 19 13:11:24 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:24 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.info" returned: 0 in 0.244s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-437622949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9855fc-29de-4aae-8e30-193060e46c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:24Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Creating volume 1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:24 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:11:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:24 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 1073741824 Jul 19 13:11:24 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d6793d2e-2458-46ce-9365-245e6a902ac7 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot e57937d3-34b3-46b0-a9c6-8219dc9cf14b: created successfully Jul 19 13:11:24 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 1073741824" returned: 0 in 0.408s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:25 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 Jul 19 13:11:25 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:25 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-412792782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42314d6d-f689-4ab0-851c-2c842749f091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85deb6129964213a91a98f31a7eefd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:24Z,use_quota=True,user_id='f744a0f41475491cad4ebb2b5939ccd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Creating volume 42314d6d-f689-4ab0-851c-2c842749f091 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:25 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d843e7-7c61-4767-bc7b-dfcceae5f398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9855fc-29de-4aae-8e30-193060e46c52', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:25 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 1073741824 Jul 19 13:11:25 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37adde1-d279-4c8c-8c53-efbdeed07d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Volume volume-1f9855fc-29de-4aae-8e30-193060e46c52 (1f9855fc-29de-4aae-8e30-193060e46c52): created successfully Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37adde1-d279-4c8c-8c53-efbdeed07d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (851dbdc4-6566-434f-b011-8703dbb91ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e252562c-99f2-421b-b5f4-36c528941430 tempest-VolumesSnapshotTestJSON-148924655 None] Created volume successfully. Jul 19 13:11:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot e57937d3-34b3-46b0-a9c6-8219dc9cf14b: deleting Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot e57937d3-34b3-46b0-a9c6-8219dc9cf14b: deleting {{(pid=87305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-739833c8-db2c-48ed-88b2-32ec0331b201" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-739833c8-db2c-48ed-88b2-32ec0331b201" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-18464fef-2ce0-444d-b762-d21d044b8328" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:25 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 1073741824" returned: 0 in 0.454s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-18464fef-2ce0-444d-b762-d21d044b8328" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Deleting offline snapshot 18464fef-2ce0-444d-b762-d21d044b8328 of volume 739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] snapshot_file for this snap is: volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed17f84-5aa6-4d21-bb88-7f26eca5e00b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:25 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 Jul 19 13:11:25 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:25 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 Jul 19 13:11:25 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:26 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091" returned: 0 in 0.264s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e978be3-37ef-49c5-95c7-49edb6302cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42314d6d-f689-4ab0-851c-2c842749f091', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eee39a-2bba-4f6a-bd5c-36e71e43e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:26 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Volume volume-42314d6d-f689-4ab0-851c-2c842749f091 (42314d6d-f689-4ab0-851c-2c842749f091): created successfully Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eee39a-2bba-4f6a-bd5c-36e71e43e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Flow 'volume_create_manager' (666ae190-cf7d-4420-8f3a-e369beb65bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f1a18708-0222-4147-9c0d-f9114b951de1 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Created volume successfully. Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:26 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328" returned: 0 in 0.452s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-739833c8-db2c-48ed-88b2-32ec0331b201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Creating offline snapshot 889321c7-4877-4648-89b6-8aab70d8302e of volume 1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f462a-e1af-4695-8dcc-d371f2e59622]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5682e276-6054-4bb2-a9f3-4a421bc364bc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:26 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 Jul 19 13:11:26 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:26 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 Jul 19 13:11:26 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:26 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:26 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52" returned: 0 in 0.372s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:26 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 Jul 19 13:11:26 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:26 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e 1G Jul 19 13:11:26 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:26 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328" returned: 0 in 0.338s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:26 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328 Jul 19 13:11:26 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:27 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e 1G" returned: 0 in 0.408s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9855fc-29de-4aae-8e30-193060e46c52 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:27 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9855fc-29de-4aae-8e30-193060e46c52 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e Jul 19 13:11:27 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:27 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201.18464fef-2ce0-444d-b762-d21d044b8328" returned: 0 in 0.258s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-18464fef-2ce0-444d-b762-d21d044b8328" released by "_delete_snapshot" :: held 1.530s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-739833c8-db2c-48ed-88b2-32ec0331b201" released by "delete_snapshot" :: held 1.561s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Acquiring lock "cinder-42314d6d-f689-4ab0-851c-2c842749f091-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "cinder-42314d6d-f689-4ab0-851c-2c842749f091-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Acquiring lock "cinder-quobyte-42314d6d-f689-4ab0-851c-2c842749f091" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:27 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:27 devstack cinder-volume[87305]: WARNING cinder.quota [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1804634325 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1804634325, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:11:27 devstack cinder-volume[87305]: WARNING cinder.quota [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1804634325 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1804634325, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9855fc-29de-4aae-8e30-193060e46c52 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e" returned: 0 in 0.327s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:27 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e is being set with open permissions: ugo+rw Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "cinder-quobyte-42314d6d-f689-4ab0-851c-2c842749f091" acquired by "delete_volume" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:27 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e Jul 19 13:11:27 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['31031aa6-2f7c-4010-ada8-5563ca2b7491', '13221864-31c3-4ffe-a4ce-620c80143e93', '10104e6d-21a3-4bd8-98b0-c855dc79e4fc', '42dd5dda-4aa6-4dc3-b94c-4156bd4c6d08'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35d3e1-1a4d-4fe7-9121-46c5a7fd6edc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:27 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-699206a7-961a-470f-a0ac-7c8290c26517 tempest-GroupSnapshotsTest-1844418931 None] group_snapshot e57937d3-34b3-46b0-a9c6-8219dc9cf14b: deleted successfully Jul 19 13:11:27 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 Jul 19 13:11:27 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:27 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:27 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.info Jul 19 13:11:27 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:27 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091" returned: 0 in 0.425s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:27 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091 Jul 19 13:11:27 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:28 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.info" returned: 0 in 0.341s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:28 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.info is being set with open permissions: ugo+rw Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:28 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.info Jul 19 13:11:28 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:28 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-42314d6d-f689-4ab0-851c-2c842749f091" returned: 0 in 0.281s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "cinder-quobyte-42314d6d-f689-4ab0-851c-2c842749f091" released by "delete_volume" :: held 0.758s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Created reservations ['c94c3ae3-7b6d-4914-94f1-5ccb32b195b7', 'e49c4d27-4890-4417-bdd5-7ade15c184b4', '7181b0e1-b52a-4fbf-a464-05a36522b4f4', '3d7d5445-5509-4f25-b512-eb43cb6d23dc'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:28 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.info" returned: 0 in 0.347s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:28 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:28 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:28 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-82c89f53-3e76-4f3f-a2d7-b34902b449f4 tempest-VolumesSnapshotTestJSON-148924655 None] Create snapshot completed successfully Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "cinder-quobyte-739833c8-db2c-48ed-88b2-32ec0331b201" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-739833c8-db2c-48ed-88b2-32ec0331b201" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5169e12-bb3a-449f-88aa-835090a08b7c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:28 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 Jul 19 13:11:28 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:28 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.337s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:28 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Deleted volume successfully. Jul 19 13:11:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-04f7269a-0b72-439e-8608-df0a789fb5da tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "cinder-42314d6d-f689-4ab0-851c-2c842749f091-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:29 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201" returned: 0 in 0.537s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:29 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201 Jul 19 13:11:29 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Flow 'volume_create_manager' (0e95a942-147a-425d-892c-ea9506572207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4aecd9c-4e49-4993-88c6-cda7595ac2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4aecd9c-4e49-4993-88c6-cda7595ac2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1431458553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b4f21e-9366-47f6-b25a-40006e208813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85deb6129964213a91a98f31a7eefd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:29Z,use_quota=True,user_id='f744a0f41475491cad4ebb2b5939ccd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1ba038-ddf2-4eb0-85af-00a099dba0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1ba038-ddf2-4eb0-85af-00a099dba0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9255d6ec-e431-4ee9-9633-c43aa856dcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9255d6ec-e431-4ee9-9633-c43aa856dcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b4f21e-9366-47f6-b25a-40006e208813', 'volume_name': 'volume-e8b4f21e-9366-47f6-b25a-40006e208813', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0e888e-f9b0-4313-8a43-f255e1651939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0e888e-f9b0-4313-8a43-f255e1651939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414fa4cb-14ae-4af9-94bf-5eff086579dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:29 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Volume e8b4f21e-9366-47f6-b25a-40006e208813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b4f21e-9366-47f6-b25a-40006e208813', 'volume_size': 1} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1431458553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b4f21e-9366-47f6-b25a-40006e208813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85deb6129964213a91a98f31a7eefd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:29Z,use_quota=True,user_id='f744a0f41475491cad4ebb2b5939ccd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Creating volume e8b4f21e-9366-47f6-b25a-40006e208813 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:29 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:29 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 1073741824 Jul 19 13:11:29 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:29 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-739833c8-db2c-48ed-88b2-32ec0331b201" returned: 0 in 0.323s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Lock "cinder-quobyte-739833c8-db2c-48ed-88b2-32ec0331b201" released by "delete_volume" :: held 0.937s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['cf782348-281c-4389-8521-d24c5bcc7d87'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:29 devstack cinder-volume[87305]: WARNING cinder.quota [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1804634325 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1804634325, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Created reservations ['bc41c8f7-f402-4c22-8824-0694c71c203c', '653312c2-61b9-45d6-9f40-c1dec02173f3', '53bfc274-44a3-4e73-92e3-b06100b3fab2', '6a7a3c30-1cfc-4b01-b905-6dcd22038b5a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:29 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:29 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:30 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 1073741824" returned: 0 in 0.714s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:30 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.332s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ca9bfddc-893f-44b7-906c-7bab7e355cbb tempest-GroupSnapshotsTest-1844418931 None] Delete group completed successfully. Jul 19 13:11:30 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 Jul 19 13:11:30 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (082e2bd4-92b4-4846-ab7c-950ec60b7d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599a3dae-8be3-49f0-9ca1-8b2bd07c34f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599a3dae-8be3-49f0-9ca1-8b2bd07c34f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1914158490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84953e26-42f5-4e39-893a-0c73ecbd4865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad64601e5824ea99fa33a02f4cff4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=889321c7-4877-4648-89b6-8aab70d8302e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:30Z,use_quota=True,user_id='5935e68c60a94ce7991d18fad9f557f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e4b797-a886-4ce1-aa87-e3407cd13486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e4b797-a886-4ce1-aa87-e3407cd13486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace032b1-f9bb-4609-8529-f5dc0baa8be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace032b1-f9bb-4609-8529-f5dc0baa8be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84953e26-42f5-4e39-893a-0c73ecbd4865', 'volume_name': 'volume-84953e26-42f5-4e39-893a-0c73ecbd4865', 'volume_size': 1, 'snapshot_id': '889321c7-4877-4648-89b6-8aab70d8302e'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b13570-1d50-420b-93ef-a863b5379bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b13570-1d50-420b-93ef-a863b5379bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fca4e0-17e7-4590-9f30-7898aca9100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Volume 84953e26-42f5-4e39-893a-0c73ecbd4865: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84953e26-42f5-4e39-893a-0c73ecbd4865', 'volume_size': 1, 'snapshot_id': '889321c7-4877-4648-89b6-8aab70d8302e'} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:30 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813" returned: 0 in 0.306s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.051s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-889321c7-4877-4648-89b6-8aab70d8302e-84953e26-42f5-4e39-893a-0c73ecbd4865" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414fa4cb-14ae-4af9-94bf-5eff086579dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b4f21e-9366-47f6-b25a-40006e208813', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c36973-8961-4f0f-a6de-b9709796abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-889321c7-4877-4648-89b6-8aab70d8302e-84953e26-42f5-4e39-893a-0c73ecbd4865" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Creating volume 84953e26-42f5-4e39-893a-0c73ecbd4865 from snapshot 889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-84953e26-42f5-4e39-893a-0c73ecbd4865" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Volume volume-e8b4f21e-9366-47f6-b25a-40006e208813 (e8b4f21e-9366-47f6-b25a-40006e208813): created successfully Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c36973-8961-4f0f-a6de-b9709796abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Flow 'volume_create_manager' (0e95a942-147a-425d-892c-ea9506572207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-84953e26-42f5-4e39-893a-0c73ecbd4865" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] snapshot: 889321c7-4877-4648-89b6-8aab70d8302e, volume: 84953e26-42f5-4e39-893a-0c73ecbd4865, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-54d30aaf-b3cc-485b-8a2d-83ab67e5f080 tempest-VolumeQuotasAdminTestJSON-1934550915 None] Created volume successfully. Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8269deb6-be28-44bb-b998-5682cc97137b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:30 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e Jul 19 13:11:30 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:30 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e" returned: 0 in 0.449s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f9855fc-29de-4aae-8e30-193060e46c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e2bfe-f28f-4ec6-83c2-fdac3ce124e4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:31 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 Jul 19 13:11:31 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:31 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52" returned: 0 in 0.515s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:31 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:11:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:31 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 Jul 19 13:11:31 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d8852b49-97b2-4eab-8ff4-c4b8d121d8fc tempest-VolumeQuotasAdminTestJSON-1334406534 None] Transfer volume completed successfully. Jul 19 13:11:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-02d9b32a-08e9-4dcf-aed8-b502d6aa5922 req-1fc3d0b4-5344-411e-9f7c-1b0bbf21fd03 tempest-TestMinimumBasicScenario-134123270 None] Terminate volume connection completed successfully. Jul 19 13:11:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-02d9b32a-08e9-4dcf-aed8-b502d6aa5922 req-1fc3d0b4-5344-411e-9f7c-1b0bbf21fd03 tempest-TestMinimumBasicScenario-134123270 None] Deleting attachment 7003f195-ddf5-4c20-adfd-8c15568a41c4. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:11:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Acquiring lock "cinder-e8b4f21e-9366-47f6-b25a-40006e208813-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Lock "cinder-e8b4f21e-9366-47f6-b25a-40006e208813-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Acquiring lock "cinder-quobyte-e8b4f21e-9366-47f6-b25a-40006e208813" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Lock "cinder-quobyte-e8b4f21e-9366-47f6-b25a-40006e208813" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d433b58-0412-49ec-a4d4-dde2448f4cea]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:34 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 Jul 19 13:11:34 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:35 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813" returned: 0 in 0.698s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:35 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813 Jul 19 13:11:35 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Acquiring lock "cinder-a37efccc-164c-4ce5-9adb-e602f91ec62a-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Lock "cinder-a37efccc-164c-4ce5-9adb-e602f91ec62a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Acquiring lock "cinder-quobyte-a37efccc-164c-4ce5-9adb-e602f91ec62a" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Lock "cinder-quobyte-a37efccc-164c-4ce5-9adb-e602f91ec62a" acquired by "delete_volume" :: waited 0.056s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a403fdf7-c960-4aa7-b690-a7a0093544b6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:35 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e8b4f21e-9366-47f6-b25a-40006e208813" returned: 0 in 0.641s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Lock "cinder-quobyte-e8b4f21e-9366-47f6-b25a-40006e208813" released by "delete_volume" :: held 1.450s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:35 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Created reservations ['976d5d94-06cd-450f-9bbd-a4ad560a648c', 'fe53b230-f15e-484d-9aa4-53aa4480f3ba', 'c79b1fbd-222f-4a8b-9ffa-cb5d24315a70', '189f8464-ba83-481a-9537-e725d0245b34'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:35 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a Jul 19 13:11:35 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:36 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:36 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:36 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.400s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Deleted volume successfully. Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee821f8b-3b75-4c30-8591-b76c81792fdb tempest-VolumeQuotasAdminTestJSON-47090972 None] Lock "cinder-e8b4f21e-9366-47f6-b25a-40006e208813-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:36 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a" returned: 0 in 1.053s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:36 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a Jul 19 13:11:36 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:37 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a37efccc-164c-4ce5-9adb-e602f91ec62a" returned: 0 in 0.976s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Lock "cinder-quobyte-a37efccc-164c-4ce5-9adb-e602f91ec62a" released by "delete_volume" :: held 2.151s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Created reservations ['a7b37207-6c9c-4d51-beec-4d7d7934c34a', 'f3deafa6-ec1d-4591-b8c8-00dff7fe1250', 'e73e8652-8590-4613-a2f6-281a2def088f', '456b7f62-ab15-45a0-b3f5-84c772017320'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:37 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865" returned: 0 in 6.468s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93457f22-6fa7-4917-b489-7c8e5ff475b9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:38 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:38 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:38 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 Jul 19 13:11:38 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:38 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.301s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Deleted volume successfully. Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6f45b01-74b7-41a5-8b90-bc1900ca683b tempest-TestMinimumBasicScenario-134123270 None] Lock "cinder-a37efccc-164c-4ce5-9adb-e602f91ec62a-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:38 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52" returned: 0 in 0.637s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:11:38 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Converted 1024.00 MB image at 158.26 MB/s Jul 19 13:11:38 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 is being set with open permissions: ugo+rw Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:38 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 Jul 19 13:11:38 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:38 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865" returned: 0 in 0.269s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-84953e26-42f5-4e39-893a-0c73ecbd4865" released by "_copy_volume_from_snapshot" :: held 8.459s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-889321c7-4877-4648-89b6-8aab70d8302e-84953e26-42f5-4e39-893a-0c73ecbd4865" released by "_create_volume_from_snapshot" :: held 8.520s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.552s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fca4e0-17e7-4590-9f30-7898aca9100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84953e26-42f5-4e39-893a-0c73ecbd4865', 'volume_size': 1, 'snapshot_id': '889321c7-4877-4648-89b6-8aab70d8302e'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5050491e-8098-4147-b887-e5107c7cf3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:38 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Volume volume-84953e26-42f5-4e39-893a-0c73ecbd4865 (84953e26-42f5-4e39-893a-0c73ecbd4865): created successfully Jul 19 13:11:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5050491e-8098-4147-b887-e5107c7cf3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Flow 'volume_create_manager' (082e2bd4-92b4-4846-ab7c-950ec60b7d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:39 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-11842d8c-b29d-4872-9f3f-a6c0bfa4e17c tempest-VolumesSnapshotTestJSON-148924655 None] Created volume successfully. Jul 19 13:11:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-84953e26-42f5-4e39-893a-0c73ecbd4865-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-84953e26-42f5-4e39-893a-0c73ecbd4865-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-84953e26-42f5-4e39-893a-0c73ecbd4865" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-84953e26-42f5-4e39-893a-0c73ecbd4865" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:39 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9bfbec-1b75-422e-b5d5-5a64e9a4418e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:39 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 Jul 19 13:11:39 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:40 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865" returned: 0 in 0.555s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:40 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865 Jul 19 13:11:40 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:40 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-84953e26-42f5-4e39-893a-0c73ecbd4865" returned: 0 in 0.385s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-84953e26-42f5-4e39-893a-0c73ecbd4865" released by "delete_volume" :: held 1.027s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['a025476e-cb3c-4b83-b5c9-d49ee0b03685', '28cc4d31-5f63-487f-ade8-fe9b63cde148', 'e41d5be6-456c-4d2c-8ff2-e606f8031325', '5eea329b-2397-4776-928f-4c3814a9b6ab'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:41 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:41 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:41 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.308s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:41 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Deleted volume successfully. Jul 19 13:11:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3ca6744b-bfba-4b24-be0d-6a094697bde4 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-84953e26-42f5-4e39-893a-0c73ecbd4865-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-889321c7-4877-4648-89b6-8aab70d8302e-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-889321c7-4877-4648-89b6-8aab70d8302e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-1f9855fc-29de-4aae-8e30-193060e46c52" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-1f9855fc-29de-4aae-8e30-193060e46c52" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-889321c7-4877-4648-89b6-8aab70d8302e" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-889321c7-4877-4648-89b6-8aab70d8302e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Deleting offline snapshot 889321c7-4877-4648-89b6-8aab70d8302e of volume 1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] snapshot_file for this snap is: volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a7f7c9-6ceb-495d-8db5-353bab699c09]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:42 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e Jul 19 13:11:42 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:42 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:42 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:42 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f9855fc-29de-4aae-8e30-193060e46c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67c2a19-a745-486b-9e30-174fdfa07a55]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:42 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.420s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:42 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:11:42 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:11:43 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52" returned: 0 in 0.476s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:43 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e Jul 19 13:11:43 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:43 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e" returned: 0 in 0.379s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:43 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e Jul 19 13:11:43 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:43 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52.889321c7-4877-4648-89b6-8aab70d8302e" returned: 0 in 0.282s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-889321c7-4877-4648-89b6-8aab70d8302e" released by "_delete_snapshot" :: held 1.767s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-1f9855fc-29de-4aae-8e30-193060e46c52" released by "delete_snapshot" :: held 1.813s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['c501a96d-63ed-4cd7-a496-b8cd74ac8ae2', '244959b1-a8cd-42b4-94f4-889af5ab56db', 'fba90b0b-1e0b-402e-96d0-38e98d0dd76d', '012cce5f-8ea1-48ee-8adf-7c34b5541fd6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:44 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Delete snapshot completed successfully. Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-28d86ed3-eadc-43dd-a75b-e92c86afd56c tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-889321c7-4877-4648-89b6-8aab70d8302e-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-1f9855fc-29de-4aae-8e30-193060e46c52-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-1f9855fc-29de-4aae-8e30-193060e46c52-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-1f9855fc-29de-4aae-8e30-193060e46c52" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-1f9855fc-29de-4aae-8e30-193060e46c52" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23aa37b-fb2d-476b-9430-2675ee974d55]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:44 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 Jul 19 13:11:44 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:44 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52" returned: 0 in 0.532s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:45 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52 Jul 19 13:11:45 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:45 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1f9855fc-29de-4aae-8e30-193060e46c52" returned: 0 in 0.353s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-1f9855fc-29de-4aae-8e30-193060e46c52" released by "delete_volume" :: held 0.978s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['305db774-1642-4c5b-adae-7daca15a9e99', 'efe2221b-105c-4d00-b4ac-8664deb82930', '1e6dd357-dd6b-4180-81a8-959df72e639a', 'd84788dc-687b-4121-aa15-745321167dba'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:45 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:45 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:45 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.394s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:45 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Deleted volume successfully. Jul 19 13:11:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c9c7a8e4-c337-4a12-a22d-5f9cfbdf4fd6 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-1f9855fc-29de-4aae-8e30-193060e46c52-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-926cb0f1-3918-4f55-b8de-3832012d600e-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-926cb0f1-3918-4f55-b8de-3832012d600e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "cinder-quobyte-926cb0f1-3918-4f55-b8de-3832012d600e" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-926cb0f1-3918-4f55-b8de-3832012d600e" acquired by "delete_volume" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:47 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41969de4-268e-4a1b-8da8-c2f88d237318]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:47 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e Jul 19 13:11:47 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:47 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e" returned: 0 in 0.484s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:47 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e Jul 19 13:11:47 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:47 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-926cb0f1-3918-4f55-b8de-3832012d600e" returned: 0 in 0.321s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-quobyte-926cb0f1-3918-4f55-b8de-3832012d600e" released by "delete_volume" :: held 0.931s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:47 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Created reservations ['90cbf39a-b9a9-4152-9bc7-34fb08cc9e73', '07b3be74-dd08-44f1-bfdd-bd8bdcf16e1d', '3139d1c9-5203-4acb-b7a2-1a40ab2a3265', '76d6f35b-e0da-4bdf-9648-725d55510ad8'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:48 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:48 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:48 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.328s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:48 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Deleted volume successfully. Jul 19 13:11:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-81a198c0-220d-462f-a69d-241cd85f60f1 tempest-VolumesSnapshotTestJSON-148924655 None] Lock "cinder-926cb0f1-3918-4f55-b8de-3832012d600e-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Flow 'volume_create_manager' (7c3c2aa9-9061-42a1-b9a5-311049e48ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ab0400-db62-4e0e-bbe8-d1722e9116a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ab0400-db62-4e0e-bbe8-d1722e9116a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2015185979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1398903-a7bf-4551-a8b8-21e0596dfdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f40039f220642d8a68735b94fa7c591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:52Z,use_quota=True,user_id='0cb45736fdbf42f2a529aa0d82dc814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9a2a7c-1f01-45bf-a377-c24f0faad73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9a2a7c-1f01-45bf-a377-c24f0faad73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b21bc32-1560-4ef8-9b33-fe22e2e2320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b21bc32-1560-4ef8-9b33-fe22e2e2320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1398903-a7bf-4551-a8b8-21e0596dfdec', 'volume_name': 'volume-d1398903-a7bf-4551-a8b8-21e0596dfdec', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8f1163-211b-4715-8f0b-c4083a54395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8f1163-211b-4715-8f0b-c4083a54395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68f94fd-69f0-45ed-9cd9-c24ae3b3f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:52 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Volume d1398903-a7bf-4551-a8b8-21e0596dfdec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1398903-a7bf-4551-a8b8-21e0596dfdec', 'volume_size': 1} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2015185979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1398903-a7bf-4551-a8b8-21e0596dfdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f40039f220642d8a68735b94fa7c591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:52Z,use_quota=True,user_id='0cb45736fdbf42f2a529aa0d82dc814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Creating volume d1398903-a7bf-4551-a8b8-21e0596dfdec {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:52 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:52 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec 1073741824 Jul 19 13:11:52 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:52 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec 1073741824" returned: 0 in 0.526s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:52 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec Jul 19 13:11:52 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:53 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec" returned: 0 in 0.387s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:11:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68f94fd-69f0-45ed-9cd9-c24ae3b3f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1398903-a7bf-4551-a8b8-21e0596dfdec', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63661148-a6f1-4845-a298-c55ae7ee4bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:53 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Volume volume-d1398903-a7bf-4551-a8b8-21e0596dfdec (d1398903-a7bf-4551-a8b8-21e0596dfdec): created successfully Jul 19 13:11:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63661148-a6f1-4845-a298-c55ae7ee4bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Flow 'volume_create_manager' (7c3c2aa9-9061-42a1-b9a5-311049e48ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-91192586-a804-40ff-9b33-b951a83a8e18 tempest-VolumesTransfersV355Test-2196798 None] Created volume successfully. Jul 19 13:11:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b8e9dd09-70f2-43cc-b833-d61913dd2239 tempest-VolumesTransfersV355Test-111236644 None] Transfer volume completed successfully. Jul 19 13:11:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Acquiring lock "cinder-d1398903-a7bf-4551-a8b8-21e0596dfdec-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-d1398903-a7bf-4551-a8b8-21e0596dfdec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=151,cinder:UPDATE=160,cinder:INSERT=42,cinder:DELETE=10 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Acquiring lock "cinder-quobyte-d1398903-a7bf-4551-a8b8-21e0596dfdec" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-quobyte-d1398903-a7bf-4551-a8b8-21e0596dfdec" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a756b6-70ec-4b81-9ff6-8c0516996f43]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:56 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec Jul 19 13:11:56 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:56 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec" returned: 0 in 0.490s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:56 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec Jul 19 13:11:56 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:57 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d1398903-a7bf-4551-a8b8-21e0596dfdec" returned: 0 in 0.438s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-quobyte-d1398903-a7bf-4551-a8b8-21e0596dfdec" released by "delete_volume" :: held 0.977s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=142,cinder:UPDATE=168,cinder:INSERT=40,cinder:DELETE=8 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Created reservations ['100341f9-3e18-4cdb-8074-8b35f42c3b46', '99e90711-8814-4396-a495-6701259acd7b', 'fe031dd9-990c-4ecb-99db-a4b6768af584', 'a653a5c9-1369-4744-a0cf-4dd5a86b79ca'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:57 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:11:57 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:57 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.339s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:11:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Deleted volume successfully. Jul 19 13:11:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b92dbbb5-c003-4224-8882-3411119e075c tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-d1398903-a7bf-4551-a8b8-21e0596dfdec-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Flow 'volume_create_manager' (9cfdaf54-d702-4cae-987d-5b83d9786b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a69ba3-aa89-46d1-9774-7b5f729dc135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a69ba3-aa89-46d1-9774-7b5f729dc135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2144408856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35895c4-1b30-427f-9f9d-9397245ec3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc50ad7501514da089aa937c5bb08d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:58Z,use_quota=True,user_id='00315c7655cb4157a78ded8f8c75ba2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a65a64b-2824-4cdb-b516-c5e8ed861269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a65a64b-2824-4cdb-b516-c5e8ed861269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646f285b-18d9-489f-8ca3-74ec021f98ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646f285b-18d9-489f-8ca3-74ec021f98ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35895c4-1b30-427f-9f9d-9397245ec3fe', 'volume_name': 'volume-b35895c4-1b30-427f-9f9d-9397245ec3fe', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e319804a-ffb4-459d-8d1d-2a575c7f58ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e319804a-ffb4-459d-8d1d-2a575c7f58ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab07ef70-0664-44e5-be9a-ccc6fe3bee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Volume b35895c4-1b30-427f-9f9d-9397245ec3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35895c4-1b30-427f-9f9d-9397245ec3fe', 'volume_size': 1} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2144408856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35895c4-1b30-427f-9f9d-9397245ec3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc50ad7501514da089aa937c5bb08d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:58Z,use_quota=True,user_id='00315c7655cb4157a78ded8f8c75ba2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Creating volume b35895c4-1b30-427f-9f9d-9397245ec3fe {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:58 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:11:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:58 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe 1073741824 Jul 19 13:11:58 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:11:59 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Flow 'volume_create_manager' (35fdb5cb-ae4e-423c-a9c6-69650a689591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dd7cf2-ab67-4ad5-bea2-65494ea62303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe 1073741824" returned: 0 in 0.535s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dd7cf2-ab67-4ad5-bea2-65494ea62303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1668726347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0d51b1-f17f-4564-a885-bb5846a4bfbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f40039f220642d8a68735b94fa7c591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:59Z,use_quota=True,user_id='0cb45736fdbf42f2a529aa0d82dc814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb213f2b-fc61-4014-832d-251f04415b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb213f2b-fc61-4014-832d-251f04415b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6053a7-0051-4766-8cc2-6dd0fa5c597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6053a7-0051-4766-8cc2-6dd0fa5c597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0d51b1-f17f-4564-a885-bb5846a4bfbd', 'volume_name': 'volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfdc3f0-adba-49fb-b7e7-744b9b8c860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfdc3f0-adba-49fb-b7e7-744b9b8c860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b886c8-8d54-4f0b-89d2-0aebe0833cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Volume ed0d51b1-f17f-4564-a885-bb5846a4bfbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd', 'volume_size': 1} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:59 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe Jul 19 13:11:59 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:59 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe" returned: 0 in 0.296s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1668726347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0d51b1-f17f-4564-a885-bb5846a4bfbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f40039f220642d8a68735b94fa7c591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:11:59Z,use_quota=True,user_id='0cb45736fdbf42f2a529aa0d82dc814d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Creating volume ed0d51b1-f17f-4564-a885-bb5846a4bfbd {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:11:59 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab07ef70-0664-44e5-be9a-ccc6fe3bee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35895c4-1b30-427f-9f9d-9397245ec3fe', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2028f-2a12-48b0-868d-c4e66f0ca1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:11:59 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd 1073741824 Jul 19 13:11:59 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:11:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Volume volume-b35895c4-1b30-427f-9f9d-9397245ec3fe (b35895c4-1b30-427f-9f9d-9397245ec3fe): created successfully Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2028f-2a12-48b0-868d-c4e66f0ca1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Flow 'volume_create_manager' (9cfdaf54-d702-4cae-987d-5b83d9786b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:11:59 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-87a17be3-e34b-4888-8067-94ddfbbcff21 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Created volume successfully. Jul 19 13:11:59 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 19 13:11:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd 1073741824" returned: 0 in 0.520s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:00 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd Jul 19 13:12:00 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:00 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd" returned: 0 in 0.241s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b886c8-8d54-4f0b-89d2-0aebe0833cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b32b99b-45b6-4f86-b2c0-02eea030e08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:00 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Volume volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd (ed0d51b1-f17f-4564-a885-bb5846a4bfbd): created successfully Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b32b99b-45b6-4f86-b2c0-02eea030e08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Flow 'volume_create_manager' (35fdb5cb-ae4e-423c-a9c6-69650a689591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0f181685-ad6b-4a42-9ffd-1c766ac7a9d0 tempest-VolumesTransfersV355Test-2196798 None] Created volume successfully. Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Acquiring lock "cinder-ed0d51b1-f17f-4564-a885-bb5846a4bfbd-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-ed0d51b1-f17f-4564-a885-bb5846a4bfbd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Acquiring lock "cinder-quobyte-ed0d51b1-f17f-4564-a885-bb5846a4bfbd" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-quobyte-ed0d51b1-f17f-4564-a885-bb5846a4bfbd" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d59b3b-68c0-4a5a-8f56-55b97ee08502]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Acquiring lock "cinder-b35895c4-1b30-427f-9f9d-9397245ec3fe-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "cinder-b35895c4-1b30-427f-9f9d-9397245ec3fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Acquiring lock "cinder-quobyte-b35895c4-1b30-427f-9f9d-9397245ec3fe" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "cinder-quobyte-b35895c4-1b30-427f-9f9d-9397245ec3fe" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:01 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd Jul 19 13:12:01 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e233d136-f851-4e88-89ec-8e2b0f7ef066]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:01 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe Jul 19 13:12:01 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:02 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd" returned: 0 in 0.608s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:02 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd Jul 19 13:12:02 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:02 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe" returned: 0 in 0.694s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:02 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe Jul 19 13:12:02 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:02 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed0d51b1-f17f-4564-a885-bb5846a4bfbd" returned: 0 in 0.448s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-quobyte-ed0d51b1-f17f-4564-a885-bb5846a4bfbd" released by "delete_volume" :: held 1.109s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Created reservations ['a5ee1956-d7d4-4ae1-b77f-fe42a09255be', 'd9b082bb-03b4-4d15-a605-1b0263b013ad', 'f653144f-927b-4ae9-8f5a-2383bedfd4ab', '2ba2e129-dcad-4ab8-9feb-ae9b0d9611dc'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:02 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b35895c4-1b30-427f-9f9d-9397245ec3fe" returned: 0 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "cinder-quobyte-b35895c4-1b30-427f-9f9d-9397245ec3fe" released by "delete_volume" :: held 1.162s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:02 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:12:02 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:02 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Created reservations ['1e419f05-d509-4b24-be56-75da5f5a9ea8', '48e43f14-7305-4b12-bee7-ddab776eb023', '0320289c-c47c-4e4a-96e6-54c2c5d10eb6', '4476b611-ef34-4385-99d7-d1e6d18b53d2'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:03 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:12:03 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:03 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.420s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:12:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Deleted volume successfully. Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7df0f7b1-17fb-4d16-885f-9dc4a43ed321 tempest-VolumesTransfersV355Test-433255881 None] Lock "cinder-ed0d51b1-f17f-4564-a885-bb5846a4bfbd-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:03 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.342s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:12:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Deleted volume successfully. Jul 19 13:12:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-78bd473e-53b5-4df3-b4eb-a96e192ba5e9 tempest-VolumeQuotasNegativeTestJSON-932052227 None] Lock "cinder-b35895c4-1b30-427f-9f9d-9397245ec3fe-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:13 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=19,cinder:INSERT=10,cinder:UPDATE=26,cinder:DELETE=4 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Flow 'volume_create_manager' (78b0e311-a745-4aa4-9329-cddee0d49334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504fda5d-3129-434c-8963-9b43c37604ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504fda5d-3129-434c-8963-9b43c37604ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1231116331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db5202f-3abd-41b5-87cc-683ca685b73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1425ba03cdf441969825685918112bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:19Z,use_quota=True,user_id='1187a59c11324a4db5ed0776e3106f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c7298d-401b-47e5-84fb-5bcbcfa7f3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c7298d-401b-47e5-84fb-5bcbcfa7f3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929f5cf1-c966-4578-a38b-88df844918c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929f5cf1-c966-4578-a38b-88df844918c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db5202f-3abd-41b5-87cc-683ca685b73a', 'volume_name': 'volume-5db5202f-3abd-41b5-87cc-683ca685b73a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfabeef6-82ad-49a7-a48e-776085456185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfabeef6-82ad-49a7-a48e-776085456185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d279e597-4ea8-474d-b5cc-637310a7fa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:19 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Volume 5db5202f-3abd-41b5-87cc-683ca685b73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db5202f-3abd-41b5-87cc-683ca685b73a', 'volume_size': 1} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1231116331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db5202f-3abd-41b5-87cc-683ca685b73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1425ba03cdf441969825685918112bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:19Z,use_quota=True,user_id='1187a59c11324a4db5ed0776e3106f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Creating volume 5db5202f-3abd-41b5-87cc-683ca685b73a {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:12:19 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:12:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:19 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a 1073741824 Jul 19 13:12:19 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:20 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a 1073741824" returned: 0 in 0.532s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:20 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a Jul 19 13:12:20 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:20 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a" returned: 0 in 0.291s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d279e597-4ea8-474d-b5cc-637310a7fa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db5202f-3abd-41b5-87cc-683ca685b73a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74cb13d-4d78-46d3-a724-d2678a0e4762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:20 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Volume volume-5db5202f-3abd-41b5-87cc-683ca685b73a (5db5202f-3abd-41b5-87cc-683ca685b73a): created successfully Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74cb13d-4d78-46d3-a724-d2678a0e4762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Flow 'volume_create_manager' (78b0e311-a745-4aa4-9329-cddee0d49334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6f34dbc1-cad2-450b-93e9-c93541818aa3 tempest-VolumesTransfersV357Test-925738008 None] Created volume successfully. Jul 19 13:12:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2314e1f6-deb7-4871-ac5b-16f4bbec07a4 tempest-VolumesTransfersV357Test-693230502 None] Transfer volume completed successfully. Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Acquiring lock "cinder-5db5202f-3abd-41b5-87cc-683ca685b73a-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-5db5202f-3abd-41b5-87cc-683ca685b73a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Acquiring lock "cinder-quobyte-5db5202f-3abd-41b5-87cc-683ca685b73a" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-quobyte-5db5202f-3abd-41b5-87cc-683ca685b73a" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aef8d3-aa60-4087-baf0-eda1ed5a94be]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:23 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a Jul 19 13:12:23 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:23 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a" returned: 0 in 0.478s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:23 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a Jul 19 13:12:23 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:24 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5db5202f-3abd-41b5-87cc-683ca685b73a" returned: 0 in 0.382s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-quobyte-5db5202f-3abd-41b5-87cc-683ca685b73a" released by "delete_volume" :: held 0.922s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Created reservations ['67e3e8c7-aa8e-4b93-afa4-648e19556a2c', 'efd09847-8dcc-4647-99bb-8fde7a7aec2a', '81ea75d6-7668-4fe2-85b7-43d3aff54ba5', '749265b1-9f15-4c10-8018-f38fc65ddf69'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:24 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:12:24 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:24 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.357s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:12:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Deleted volume successfully. Jul 19 13:12:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cec6ac9c-f49f-4b0e-a6f5-5191b7a5da51 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-5db5202f-3abd-41b5-87cc-683ca685b73a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Flow 'volume_create_manager' (b163127e-3eea-4605-bbe4-762d28836465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de591bcc-2456-44fc-a0f7-63bfd0f6b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de591bcc-2456-44fc-a0f7-63bfd0f6b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-601411497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecf0e8c-325b-4e4d-a0fb-4b243d12e042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1425ba03cdf441969825685918112bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:26Z,use_quota=True,user_id='1187a59c11324a4db5ed0776e3106f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56993a-907e-4043-8bd5-99ae27172e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56993a-907e-4043-8bd5-99ae27172e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51afbc9-66f4-4680-99f8-b24d587c596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51afbc9-66f4-4680-99f8-b24d587c596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecf0e8c-325b-4e4d-a0fb-4b243d12e042', 'volume_name': 'volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdd8731-ebd6-4d70-a176-be1b3e4193a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdd8731-ebd6-4d70-a176-be1b3e4193a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e24b0f-b45a-4b8b-98d4-628e9157613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:26 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Volume 1ecf0e8c-325b-4e4d-a0fb-4b243d12e042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042', 'volume_size': 1} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-601411497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecf0e8c-325b-4e4d-a0fb-4b243d12e042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1425ba03cdf441969825685918112bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:26Z,use_quota=True,user_id='1187a59c11324a4db5ed0776e3106f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Creating volume 1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:12:26 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:12:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:26 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 1073741824 Jul 19 13:12:26 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Flow 'volume_create_manager' (f7bacb5f-7140-4d29-8dec-bce015519271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db54eca-6cd3-4c75-bfc4-f21d2e10f207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db54eca-6cd3-4c75-bfc4-f21d2e10f207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-897815564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b34463b-c102-4cba-99f5-67c3629bc1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100a161b2cd5449ba55cd1b0a69d67a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:27Z,use_quota=True,user_id='76e29e43bc224cc3ac73cbe926c5add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d40c2ae0-2d08-4745-8df5-6e8c8268bb4d),volume_type_id=d40c2ae0-2d08-4745-8df5-6e8c8268bb4d)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7166c4ec-0b9b-41d8-905f-3eccdf46411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7166c4ec-0b9b-41d8-905f-3eccdf46411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c05b94-47e0-4301-ae49-e76da8776937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c05b94-47e0-4301-ae49-e76da8776937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b34463b-c102-4cba-99f5-67c3629bc1c2', 'volume_name': 'volume-2b34463b-c102-4cba-99f5-67c3629bc1c2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f016fd4-164a-4291-be42-fd36b6fdcec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f016fd4-164a-4291-be42-fd36b6fdcec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394dce32-f6ae-4f7f-96aa-f4f1ea81b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:27 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Volume 2b34463b-c102-4cba-99f5-67c3629bc1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b34463b-c102-4cba-99f5-67c3629bc1c2', 'volume_size': 1} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:27 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 1073741824" returned: 0 in 0.737s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:27 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 Jul 19 13:12:27 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:27 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042" returned: 0 in 0.428s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-897815564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b34463b-c102-4cba-99f5-67c3629bc1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100a161b2cd5449ba55cd1b0a69d67a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:27Z,use_quota=True,user_id='76e29e43bc224cc3ac73cbe926c5add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d40c2ae0-2d08-4745-8df5-6e8c8268bb4d),volume_type_id=d40c2ae0-2d08-4745-8df5-6e8c8268bb4d)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Creating volume 2b34463b-c102-4cba-99f5-67c3629bc1c2 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:12:27 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:12:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:27 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 1073741824 Jul 19 13:12:27 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e24b0f-b45a-4b8b-98d4-628e9157613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bcb50e-c312-486c-a26a-e1706ffb8cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Flow 'volume_create_manager' (0912e82e-82a3-4ebe-92cc-f7f6abc5f6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e3278-c9ce-4251-a138-f196db240c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:28 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Volume volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 (1ecf0e8c-325b-4e4d-a0fb-4b243d12e042): created successfully Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bcb50e-c312-486c-a26a-e1706ffb8cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Flow 'volume_create_manager' (b163127e-3eea-4605-bbe4-762d28836465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:28 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-dc4425ed-f8d0-4cce-8981-e6f242d4e900 tempest-VolumesTransfersV357Test-925738008 None] Created volume successfully. Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e3278-c9ce-4251-a138-f196db240c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132556817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100a161b2cd5449ba55cd1b0a69d67a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:28Z,use_quota=True,user_id='76e29e43bc224cc3ac73cbe926c5add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcf4346-2c81-4c6e-ad13-3ca8371969f5),volume_type_id=1fcf4346-2c81-4c6e-ad13-3ca8371969f5)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9866b0e7-92d2-4c63-b9da-c1ecabd32f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9866b0e7-92d2-4c63-b9da-c1ecabd32f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d2fb60-981d-4e49-8840-0bab2a772e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d2fb60-981d-4e49-8840-0bab2a772e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e', 'volume_name': 'volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fecc59-d8bd-4f9a-8c6d-c109c5bb1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fecc59-d8bd-4f9a-8c6d-c109c5bb1881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0073c449-ec5d-49e6-abe0-951a9722c25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:28 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Volume 4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e', 'volume_size': 1} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:28 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 1073741824" returned: 0 in 0.902s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:28 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 Jul 19 13:12:28 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Acquiring lock "cinder-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Acquiring lock "cinder-quobyte-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-quobyte-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc36d955-7f84-49fc-b98b-21102e8cef1d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:29 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 Jul 19 13:12:29 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:29 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2" returned: 0 in 0.497s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132556817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100a161b2cd5449ba55cd1b0a69d67a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:28Z,use_quota=True,user_id='76e29e43bc224cc3ac73cbe926c5add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcf4346-2c81-4c6e-ad13-3ca8371969f5),volume_type_id=1fcf4346-2c81-4c6e-ad13-3ca8371969f5)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Creating volume 4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:12:29 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394dce32-f6ae-4f7f-96aa-f4f1ea81b549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b34463b-c102-4cba-99f5-67c3629bc1c2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece2b2be-c8b1-4f96-b3cd-8e07e99bbd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:29 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e 1073741824 Jul 19 13:12:29 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:29 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Volume volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 (2b34463b-c102-4cba-99f5-67c3629bc1c2): created successfully Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece2b2be-c8b1-4f96-b3cd-8e07e99bbd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Flow 'volume_create_manager' (f7bacb5f-7140-4d29-8dec-bce015519271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8acd3f87-4127-41af-ac90-f0c7f2d182cd tempest-TestInstancesWithCinderVolumes-215654207 None] Created volume successfully. Jul 19 13:12:29 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042" returned: 0 in 0.538s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:29 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042 Jul 19 13:12:29 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Flow 'volume_create_manager' (b54e55f8-020c-4385-8d9e-3b0d333e9f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747ccff2-a013-4ece-8c35-a87f009b865c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747ccff2-a013-4ece-8c35-a87f009b865c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1581824485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fda8cb3-0200-4c4e-97a1-a1053f5c254e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100a161b2cd5449ba55cd1b0a69d67a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:30Z,use_quota=True,user_id='76e29e43bc224cc3ac73cbe926c5add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(accd7809-6662-4745-b3a2-2140f8c4d28d),volume_type_id=accd7809-6662-4745-b3a2-2140f8c4d28d)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae979126-25fc-4c68-90af-adb38745e38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae979126-25fc-4c68-90af-adb38745e38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338b9557-34bf-45e3-a31f-3285e563e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:29 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:12:30 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e 1073741824" returned: 0 in 0.762s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:30 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042" returned: 0 in 0.476s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-quobyte-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042" released by "delete_volume" :: held 1.085s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:30 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e Jul 19 13:12:30 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338b9557-34bf-45e3-a31f-3285e563e48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fda8cb3-0200-4c4e-97a1-a1053f5c254e', 'volume_name': 'volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e', 'volume_size': 1, 'image_id': 'a31350d2-b04f-474f-a671-cedd67dbb665', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a31350d2-b04f-474f-a671-cedd67dbb665', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--289773803', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '100a161b2cd5449ba55cd1b0a69d67a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a31350d2-b04f-474f-a671-cedd67dbb665', 'created_at': datetime.datetime(2026, 7, 19, 11, 12, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 12, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a31350d2-b04f-474f-a671-cedd67dbb665/file', 'properties': {}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16190828-f202-4f48-8a1b-38b4068d345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16190828-f202-4f48-8a1b-38b4068d345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f001291f-3c53-4b6e-80e9-959e18833685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Volume 8fda8cb3-0200-4c4e-97a1-a1053f5c254e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e', 'volume_size': 1, 'image_id': 'a31350d2-b04f-474f-a671-cedd67dbb665', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a31350d2-b04f-474f-a671-cedd67dbb665', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--289773803', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '100a161b2cd5449ba55cd1b0a69d67a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a31350d2-b04f-474f-a671-cedd67dbb665', 'created_at': datetime.datetime(2026, 7, 19, 11, 12, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 12, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a31350d2-b04f-474f-a671-cedd67dbb665/file', 'properties': {}}, 'image_service': } Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Trying to clone 8fda8cb3-0200-4c4e-97a1-a1053f5c254e from image a31350d2-b04f-474f-a671-cedd67dbb665 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a31350d2-b04f-474f-a671-cedd67dbb665', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Created reservations ['5bf2de39-fcc7-467e-8d47-41c9f0bc8d4e', 'f35990ae-2ea8-4fad-a89e-75585ea503ad', 'ac1476cb-b49d-4081-8c1a-18c82cef61ac', '22795534-cca1-4fc2-9e0a-75aa03bfe742'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:30 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:12:30 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:30 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e" returned: 0 in 0.475s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0073c449-ec5d-49e6-abe0-951a9722c25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356708a8-b88e-4560-ad7e-cd67a4cc5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Volume volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e (4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e): created successfully Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356708a8-b88e-4560-ad7e-cd67a4cc5c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Flow 'volume_create_manager' (0912e82e-82a3-4ebe-92cc-f7f6abc5f6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-53b0e8d4-f4b0-43d1-87a3-9a4bc98d8cb3 tempest-TestInstancesWithCinderVolumes-215654207 None] Created volume successfully. Jul 19 13:12:30 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.395s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:12:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Deleted volume successfully. Jul 19 13:12:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3140c135-7858-4c41-8504-7001f7bbf160 tempest-VolumesTransfersV357Test-577999289 None] Lock "cinder-1ecf0e8c-325b-4e4d-a0fb-4b243d12e042-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:12:35 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD, size 20.69 MB, duration 4.71 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:12:35 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Image download 20.69 MB at 4.39 MB/s Jul 19 13:12:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f6c7e-102f-41a5-a48c-ac514940dd39]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:35 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD Jul 19 13:12:35 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:35 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:35 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Temporary image a31350d2-b04f-474f-a671-cedd67dbb665 is fetched for user 76e29e43bc224cc3ac73cbe926c5add1. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:12:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24529678-bebf-411f-98e2-21505070ea3d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:35 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD Jul 19 13:12:35 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:36 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1581824485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fda8cb3-0200-4c4e-97a1-a1053f5c254e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100a161b2cd5449ba55cd1b0a69d67a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:30Z,use_quota=True,user_id='76e29e43bc224cc3ac73cbe926c5add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(accd7809-6662-4745-b3a2-2140f8c4d28d),volume_type_id=accd7809-6662-4745-b3a2-2140f8c4d28d)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Creating volume 8fda8cb3-0200-4c4e-97a1-a1053f5c254e {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:12:36 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:36 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e 1073741824 Jul 19 13:12:36 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:36 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e 1073741824" returned: 0 in 0.540s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:36 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e Jul 19 13:12:36 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:37 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e" returned: 0 in 0.306s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Attempting download of a31350d2-b04f-474f-a671-cedd67dbb665 ((None, [{'url': 'file:///opt/stack/data/glance/images/a31350d2-b04f-474f-a671-cedd67dbb665', 'metadata': {}}])) to volume 8fda8cb3-0200-4c4e-97a1-a1053f5c254e. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[587d1f5a-13a9-409f-abc8-4ab679c08257]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a31350d2-b04f-474f-a671-cedd67dbb665_r4t17eg3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:37 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a31350d2-b04f-474f-a671-cedd67dbb665_r4t17eg3 Jul 19 13:12:37 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:37 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a31350d2-b04f-474f-a671-cedd67dbb665_r4t17eg3" returned: 0 in 0.364s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a31350d2-b04f-474f-a671-cedd67dbb665_r4t17eg3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:37 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a31350d2-b04f-474f-a671-cedd67dbb665_r4t17eg3 Jul 19 13:12:37 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:37 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a31350d2-b04f-474f-a671-cedd67dbb665_r4t17eg3" returned: 1 in 0.369s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a31350d2-b04f-474f-a671-cedd67dbb665_r4t17eg3' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff15c1a-fa0a-4f62-9965-f7b9e16dddec]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:12:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:37 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD Jul 19 13:12:37 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:38 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:38 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] a31350d2-b04f-474f-a671-cedd67dbb665 was qcow2, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:12:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:38 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e Jul 19 13:12:38 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:40 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e" returned: 0 in 2.333s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:40 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a31350d2-b04f-474f-a671-cedd67dbb665_p5p3hbsrdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:12:40 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Converted 112.00 MB image at 47.95 MB/s Jul 19 13:12:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:40 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e 1G Jul 19 13:12:40 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:41 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e 1G" returned: 0 in 0.416s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Downloaded image a31350d2-b04f-474f-a671-cedd67dbb665 ((None, [{'url': 'file:///opt/stack/data/glance/images/a31350d2-b04f-474f-a671-cedd67dbb665', 'metadata': {}}])) to volume 8fda8cb3-0200-4c4e-97a1-a1053f5c254e successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Temporary image a31350d2-b04f-474f-a671-cedd67dbb665 for user 76e29e43bc224cc3ac73cbe926c5add1 is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Marking volume 8fda8cb3-0200-4c4e-97a1-a1053f5c254e as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Copying metadata from image a31350d2-b04f-474f-a671-cedd67dbb665 to 8fda8cb3-0200-4c4e-97a1-a1053f5c254e. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Creating volume glance metadata for volume 8fda8cb3-0200-4c4e-97a1-a1053f5c254e backed by image a31350d2-b04f-474f-a671-cedd67dbb665 with: {'image_id': 'a31350d2-b04f-474f-a671-cedd67dbb665', 'image_name': 'tempest-scenario-img--289773803', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f001291f-3c53-4b6e-80e9-959e18833685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e', 'volume_size': 1, 'image_id': 'a31350d2-b04f-474f-a671-cedd67dbb665', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a31350d2-b04f-474f-a671-cedd67dbb665', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--289773803', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '100a161b2cd5449ba55cd1b0a69d67a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a31350d2-b04f-474f-a671-cedd67dbb665', 'created_at': datetime.datetime(2026, 7, 19, 11, 12, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 12, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a31350d2-b04f-474f-a671-cedd67dbb665/file', 'properties': {}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0037f3-ad3f-42a9-a376-bdb794de9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Volume volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e (8fda8cb3-0200-4c4e-97a1-a1053f5c254e): created successfully Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0037f3-ad3f-42a9-a376-bdb794de9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Flow 'volume_create_manager' (b54e55f8-020c-4385-8d9e-3b0d333e9f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fe047804-1ede-4319-ba6d-aacbb08aacb4 tempest-TestInstancesWithCinderVolumes-215654207 None] Created volume successfully. Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:42 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:12:42 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:42 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.299s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:12:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:12:51 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:INSERT=15,cinder:UPDATE=64,cinder:SELECT=46,cinder:DELETE=4 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:12:51 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=23,cinder:INSERT=11,cinder:UPDATE=35,cinder:DELETE=4 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:12:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-bb62bade-5d67-4f3d-b054-d04de5bc1f1d req-5be49077-dad5-47c0-81a1-7b563a94fa4b tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-bb62bade-5d67-4f3d-b054-d04de5bc1f1d req-5be49077-dad5-47c0-81a1-7b563a94fa4b tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-bb62bade-5d67-4f3d-b054-d04de5bc1f1d req-5be49077-dad5-47c0-81a1-7b563a94fa4b tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-bb62bade-5d67-4f3d-b054-d04de5bc1f1d req-5be49077-dad5-47c0-81a1-7b563a94fa4b tempest-TestInstancesWithCinderVolumes-215654207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2283614d-7d54-47f2-8c67-68ec914fbcbe', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:12:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-bb62bade-5d67-4f3d-b054-d04de5bc1f1d req-5be49077-dad5-47c0-81a1-7b563a94fa4b tempest-TestInstancesWithCinderVolumes-215654207 None] attachment_update completed successfully. Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Flow 'volume_create_manager' (eded117f-65f5-4114-a4f3-6809ded72e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b544df-e74d-409d-bd64-60b71d4cf5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b544df-e74d-409d-bd64-60b71d4cf5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1489196279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da192f1b-1b85-45cb-9c79-fb4bc0faf928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d324ebb0218c43479a5472889e340a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:58Z,use_quota=True,user_id='bbe9ab5be2d84591a87381c2b9e8bb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a387fc-dd07-4660-b3e8-7bd28eb02797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a387fc-dd07-4660-b3e8-7bd28eb02797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cef73c0-f9c7-418b-8c3e-12e373c900ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cef73c0-f9c7-418b-8c3e-12e373c900ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da192f1b-1b85-45cb-9c79-fb4bc0faf928', 'volume_name': 'volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1985ff-6cfa-4031-a103-152eb6bac001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1985ff-6cfa-4031-a103-152eb6bac001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f9c07e-b5b6-4ec9-a961-c1e1ba398821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Volume da192f1b-1b85-45cb-9c79-fb4bc0faf928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928', 'volume_size': 1} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1489196279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da192f1b-1b85-45cb-9c79-fb4bc0faf928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d324ebb0218c43479a5472889e340a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:12:58Z,use_quota=True,user_id='bbe9ab5be2d84591a87381c2b9e8bb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Creating volume da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:12:58 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:12:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:58 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 1073741824 Jul 19 13:12:58 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:59 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 1073741824" returned: 0 in 0.785s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:12:59 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:12:59 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:12:59 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.338s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f9c07e-b5b6-4ec9-a961-c1e1ba398821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb20be9b-f923-40b8-9877-69ae911d39ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:12:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Volume volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 (da192f1b-1b85-45cb-9c79-fb4bc0faf928): created successfully Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb20be9b-f923-40b8-9877-69ae911d39ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:12:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Flow 'volume_create_manager' (eded117f-65f5-4114-a4f3-6809ded72e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:12:59 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-55aa69ee-1ad7-469d-a8b6-8d7c462108fb tempest-VolumesActionsTest-1604717805 None] Created volume successfully. Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (1d12cbe1-6970-4e4d-82ad-bd4d29f651dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd88adf-bd88-43ca-acce-bc6a5aade164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd88adf-bd88-43ca-acce-bc6a5aade164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298815796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b84bd6-edd6-486c-8a59-790701531517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:08Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b8d70a-3880-4592-a820-449bdf3a77f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b8d70a-3880-4592-a820-449bdf3a77f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fbd384-ca8b-4980-a3e9-f26595cb0991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fbd384-ca8b-4980-a3e9-f26595cb0991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b84bd6-edd6-486c-8a59-790701531517', 'volume_name': 'volume-54b84bd6-edd6-486c-8a59-790701531517', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb7b5d-5a0a-4153-9072-63292c42fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb7b5d-5a0a-4153-9072-63292c42fe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b11efd0-fb5b-4495-b507-725074f5d215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:07 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Volume 54b84bd6-edd6-486c-8a59-790701531517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b84bd6-edd6-486c-8a59-790701531517', 'volume_size': 1} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298815796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b84bd6-edd6-486c-8a59-790701531517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:08Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Creating volume 54b84bd6-edd6-486c-8a59-790701531517 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:13:07 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:13:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:07 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 1073741824 Jul 19 13:13:07 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:09 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 1073741824" returned: 0 in 1.134s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:09 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 Jul 19 13:13:09 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:09 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517" returned: 0 in 0.689s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:13:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b11efd0-fb5b-4495-b507-725074f5d215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b84bd6-edd6-486c-8a59-790701531517', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c2875a-072b-4cd3-b3e9-91475758b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Volume volume-54b84bd6-edd6-486c-8a59-790701531517 (54b84bd6-edd6-486c-8a59-790701531517): created successfully Jul 19 13:13:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c2875a-072b-4cd3-b3e9-91475758b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (1d12cbe1-6970-4e4d-82ad-bd4d29f651dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:10 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5bc370d2-106d-4377-ab1d-7d468b5125de tempest-VolumesActionsTest-1735593945 None] Created volume successfully. Jul 19 13:13:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-52f5185c-e13f-4bc7-8e6f-9d97c3b04615 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "cinder-54b84bd6-edd6-486c-8a59-790701531517" by "attach_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-52f5185c-e13f-4bc7-8e6f-9d97c3b04615 tempest-VolumesActionsTest-1735593945 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517" acquired by "attach_volume" :: waited 0.044s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-52f5185c-e13f-4bc7-8e6f-9d97c3b04615 tempest-VolumesActionsTest-1735593945 None] Attaching volume 54b84bd6-edd6-486c-8a59-790701531517 to instance ad2c42f0-81cd-49d5-b4f8-3f1d20d15b6e at mountpoint /dev/vdb on host None. Jul 19 13:13:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-52f5185c-e13f-4bc7-8e6f-9d97c3b04615 tempest-VolumesActionsTest-1735593945 None] Attach volume completed successfully. Jul 19 13:13:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-52f5185c-e13f-4bc7-8e6f-9d97c3b04615 tempest-VolumesActionsTest-1735593945 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517" released by "attach_volume" :: held 0.315s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a8749aeb-6d66-4eb4-a83e-098304a01c2f tempest-VolumesActionsTest-1863149484 None] Terminate volume connection completed successfully. Jul 19 13:13:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a8749aeb-6d66-4eb4-a83e-098304a01c2f tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-detach_volume" by "detach_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a8749aeb-6d66-4eb4-a83e-098304a01c2f tempest-VolumesActionsTest-1863149484 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a8749aeb-6d66-4eb4-a83e-098304a01c2f tempest-VolumesActionsTest-1863149484 None] Detaching volume 54b84bd6-edd6-486c-8a59-790701531517 from instance ad2c42f0-81cd-49d5-b4f8-3f1d20d15b6e. Jul 19 13:13:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a8749aeb-6d66-4eb4-a83e-098304a01c2f tempest-VolumesActionsTest-1863149484 None] Detach volume completed successfully. Jul 19 13:13:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a8749aeb-6d66-4eb4-a83e-098304a01c2f tempest-VolumesActionsTest-1863149484 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-detach_volume" released by "detach_volume" :: held 0.449s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e5b93ab-db19-4399-beb9-a6f1ab2cf7fc tempest-VolumesActionsTest-1735593945 None] Acquiring lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-detach_volume" by "detach_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e5b93ab-db19-4399-beb9-a6f1ab2cf7fc tempest-VolumesActionsTest-1735593945 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-detach_volume" acquired by "detach_volume" :: waited 0.113s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3e5b93ab-db19-4399-beb9-a6f1ab2cf7fc tempest-VolumesActionsTest-1735593945 None] Volume detach called, but volume not attached. Jul 19 13:13:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3e5b93ab-db19-4399-beb9-a6f1ab2cf7fc tempest-VolumesActionsTest-1735593945 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "cinder-quobyte-54b84bd6-edd6-486c-8a59-790701531517" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Lock "cinder-quobyte-54b84bd6-edd6-486c-8a59-790701531517" acquired by "delete_volume" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:15 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58be2c97-f04f-4611-ab9c-ae6436ccb359]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:15 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 Jul 19 13:13:15 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:16 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517" returned: 0 in 1.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:16 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517 Jul 19 13:13:16 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:17 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54b84bd6-edd6-486c-8a59-790701531517" returned: 0 in 0.549s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Lock "cinder-quobyte-54b84bd6-edd6-486c-8a59-790701531517" released by "delete_volume" :: held 2.073s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Created reservations ['cd5759e6-2c30-41da-bdc4-5074126d3b8e', '64f1a3ac-f646-4bf7-aa54-f9d2eeab13ba', '910ef66d-94f6-4e5a-9df9-34121a388802', '0fb264c7-25b0-414d-a667-b23bdea4692a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:17 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:13:17 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:18 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.806s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:18 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:13:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Deleted volume successfully. Jul 19 13:13:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8866eb42-6a89-469d-a866-c4bb5486a904 tempest-VolumesActionsTest-1735593945 None] Lock "cinder-54b84bd6-edd6-486c-8a59-790701531517-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ed1afb8c-7dfd-4292-983c-f26065aeea96 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928" by "attach_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ed1afb8c-7dfd-4292-983c-f26065aeea96 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928" acquired by "attach_volume" :: waited 0.044s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ed1afb8c-7dfd-4292-983c-f26065aeea96 tempest-VolumesActionsTest-1604717805 None] Attaching volume da192f1b-1b85-45cb-9c79-fb4bc0faf928 to instance 14bd06d8-699c-45b0-a9a6-5e2cc3b3379c at mountpoint /dev/vdb on host None. Jul 19 13:13:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ed1afb8c-7dfd-4292-983c-f26065aeea96 tempest-VolumesActionsTest-1604717805 None] Attach volume completed successfully. Jul 19 13:13:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ed1afb8c-7dfd-4292-983c-f26065aeea96 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928" released by "attach_volume" :: held 0.207s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ec7b9dc-39e0-47c0-aa64-4249ec88ed20 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-detach_volume" by "detach_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ec7b9dc-39e0-47c0-aa64-4249ec88ed20 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-detach_volume" acquired by "detach_volume" :: waited 0.077s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2ec7b9dc-39e0-47c0-aa64-4249ec88ed20 tempest-VolumesActionsTest-1604717805 None] Detaching volume da192f1b-1b85-45cb-9c79-fb4bc0faf928 from instance 14bd06d8-699c-45b0-a9a6-5e2cc3b3379c. Jul 19 13:13:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2ec7b9dc-39e0-47c0-aa64-4249ec88ed20 tempest-VolumesActionsTest-1604717805 None] Detach volume completed successfully. Jul 19 13:13:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2ec7b9dc-39e0-47c0-aa64-4249ec88ed20 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Flow 'volume_create_manager' (4f59d715-0228-4cc0-a60e-e8d19a226b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa686b5-d866-42f3-a4cd-678c924d53f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa686b5-d866-42f3-a4cd-678c924d53f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-933869585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566f0ac8-0678-4ded-89a5-9c29880f7ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0555f779e4b41a79db4432bd4142322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:23Z,use_quota=True,user_id='eb8de73d94ad408f9e21e408fa54f7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f812e0c-ed4c-475d-9593-171610c75845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f812e0c-ed4c-475d-9593-171610c75845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c834b88-1c67-4445-bd85-1942529fc0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c834b88-1c67-4445-bd85-1942529fc0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566f0ac8-0678-4ded-89a5-9c29880f7ba5', 'volume_name': 'volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3335eeb5-082a-48ae-8676-e28c12dff891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3335eeb5-082a-48ae-8676-e28c12dff891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ca6e8b-be87-42b7-b5a2-374495a67c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:23 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Volume 566f0ac8-0678-4ded-89a5-9c29880f7ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5', 'volume_size': 1} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-933869585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566f0ac8-0678-4ded-89a5-9c29880f7ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0555f779e4b41a79db4432bd4142322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:23Z,use_quota=True,user_id='eb8de73d94ad408f9e21e408fa54f7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Creating volume 566f0ac8-0678-4ded-89a5-9c29880f7ba5 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:13:23 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:13:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:23 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 1073741824 Jul 19 13:13:23 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:24 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 1073741824" returned: 0 in 0.916s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:24 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 Jul 19 13:13:24 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:25 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5" returned: 0 in 0.498s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ca6e8b-be87-42b7-b5a2-374495a67c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484432b5-3130-4ff6-87e0-84bac717d298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Volume volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 (566f0ac8-0678-4ded-89a5-9c29880f7ba5): created successfully Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484432b5-3130-4ff6-87e0-84bac717d298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Flow 'volume_create_manager' (4f59d715-0228-4cc0-a60e-e8d19a226b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-73eeac11-49c3-4acb-8d90-cf0b074d6066 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Created volume successfully. Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (b13d97bd-cf49-4dbd-bfb7-e20cecdcb9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a55dc2-5c68-488b-80a9-2aafcb3f029c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a55dc2-5c68-488b-80a9-2aafcb3f029c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111057568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd8a639-8680-4767-90d6-7969d28a2281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:25Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff3f56a-3695-40b9-814c-7f083c216531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff3f56a-3695-40b9-814c-7f083c216531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3619d1-ea56-47ff-85f1-b0e736a0a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3619d1-ea56-47ff-85f1-b0e736a0a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd8a639-8680-4767-90d6-7969d28a2281', 'volume_name': 'volume-6fd8a639-8680-4767-90d6-7969d28a2281', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a04efdd-4f48-4525-93fd-b3f26ae9c3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a04efdd-4f48-4525-93fd-b3f26ae9c3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e4ffc0-a0b7-4e51-89fc-1a5b6e392e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Volume 6fd8a639-8680-4767-90d6-7969d28a2281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd8a639-8680-4767-90d6-7969d28a2281', 'volume_size': 1} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111057568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd8a639-8680-4767-90d6-7969d28a2281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:25Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Creating volume 6fd8a639-8680-4767-90d6-7969d28a2281 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:13:25 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:13:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:25 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 1073741824 Jul 19 13:13:25 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:26 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 1073741824" returned: 0 in 0.615s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:26 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 Jul 19 13:13:26 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:26 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281" returned: 0 in 0.476s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e4ffc0-a0b7-4e51-89fc-1a5b6e392e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd8a639-8680-4767-90d6-7969d28a2281', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb194ee-e2ea-4d5f-b2f6-351c8cda4d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:26 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Volume volume-6fd8a639-8680-4767-90d6-7969d28a2281 (6fd8a639-8680-4767-90d6-7969d28a2281): created successfully Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb194ee-e2ea-4d5f-b2f6-351c8cda4d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (b13d97bd-cf49-4dbd-bfb7-e20cecdcb9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8cc47166-3985-4a5b-b37a-b3059a66b451 tempest-VolumesActionsTest-1735593945 None] Created volume successfully. Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-4d701a7c-2a8d-4420-8251-f591a6b5d011 req-4f72d8fa-89e8-4f0b-8b95-dd0047f74056 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-4d701a7c-2a8d-4420-8251-f591a6b5d011 req-4f72d8fa-89e8-4f0b-8b95-dd0047f74056 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-4d701a7c-2a8d-4420-8251-f591a6b5d011 req-4f72d8fa-89e8-4f0b-8b95-dd0047f74056 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-4d701a7c-2a8d-4420-8251-f591a6b5d011 req-4f72d8fa-89e8-4f0b-8b95-dd0047f74056 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58ba4187-eff3-4058-9222-350592df02f8', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:13:27 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-4d701a7c-2a8d-4420-8251-f591a6b5d011 req-4f72d8fa-89e8-4f0b-8b95-dd0047f74056 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] attachment_update completed successfully. Jul 19 13:13:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-6fd8a639-8680-4767-90d6-7969d28a2281-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-6fd8a639-8680-4767-90d6-7969d28a2281-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-quobyte-6fd8a639-8680-4767-90d6-7969d28a2281" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-6fd8a639-8680-4767-90d6-7969d28a2281" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[552459c7-40a3-47dd-b608-e187362124a1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:28 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 Jul 19 13:13:28 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:28 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281" returned: 0 in 0.466s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:28 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281 Jul 19 13:13:28 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:28 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6fd8a639-8680-4767-90d6-7969d28a2281" returned: 0 in 0.325s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-6fd8a639-8680-4767-90d6-7969d28a2281" released by "delete_volume" :: held 0.849s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:28 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Created reservations ['201faa81-a004-4ff3-83eb-72be79da69cf', 'c01d5610-2520-4de1-96ea-ce628ab4fbd2', '2ccb434e-8ea3-43d6-9eaa-21489b40c004', '68583a63-34cd-4426-8c94-a5eb4283ff5c'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:29 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:13:29 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:29 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:13:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Deleted volume successfully. Jul 19 13:13:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d3a32e-efeb-4eae-9370-99baa0674bb9 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-6fd8a639-8680-4767-90d6-7969d28a2281-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-f9e0c98f-db29-46b7-83a1-f5c5197d6108 req-bb8294f2-f67f-480e-8be3-54955f9b52f6 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Terminate volume connection completed successfully. Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-f9e0c98f-db29-46b7-83a1-f5c5197d6108 req-bb8294f2-f67f-480e-8be3-54955f9b52f6 tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Deleting attachment 58ba4187-eff3-4058-9222-350592df02f8. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (c9207051-9c32-41e1-9795-dcb4399435be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094c3060-af48-4611-9c6e-02aa3d019ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094c3060-af48-4611-9c6e-02aa3d019ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012631844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16adbaf8-74d0-45b6-b935-af8faf1eef09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:31Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308a802d-2f59-4799-954a-bd7b36c04a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308a802d-2f59-4799-954a-bd7b36c04a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846576b0-b85c-4d32-b63c-03f1cb6d1253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846576b0-b85c-4d32-b63c-03f1cb6d1253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16adbaf8-74d0-45b6-b935-af8faf1eef09', 'volume_name': 'volume-16adbaf8-74d0-45b6-b935-af8faf1eef09', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bab7166-dcce-47d8-b2a3-90d0607f8b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bab7166-dcce-47d8-b2a3-90d0607f8b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf90ecfc-35a6-4031-bdb5-fb6242afda1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Volume 16adbaf8-74d0-45b6-b935-af8faf1eef09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16adbaf8-74d0-45b6-b935-af8faf1eef09', 'volume_size': 1} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012631844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16adbaf8-74d0-45b6-b935-af8faf1eef09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:31Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Creating volume 16adbaf8-74d0-45b6-b935-af8faf1eef09 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:13:30 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:13:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:30 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 1073741824 Jul 19 13:13:30 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Acquiring lock "cinder-566f0ac8-0678-4ded-89a5-9c29880f7ba5-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:31 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 1073741824" returned: 0 in 0.798s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "cinder-566f0ac8-0678-4ded-89a5-9c29880f7ba5-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Acquiring lock "cinder-quobyte-566f0ac8-0678-4ded-89a5-9c29880f7ba5" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:31 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 Jul 19 13:13:31 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "cinder-quobyte-566f0ac8-0678-4ded-89a5-9c29880f7ba5" acquired by "delete_volume" :: waited 0.049s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eac5af-1416-406c-936a-65143262aaea]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:32 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 Jul 19 13:13:32 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:32 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09" returned: 0 in 0.440s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf90ecfc-35a6-4031-bdb5-fb6242afda1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16adbaf8-74d0-45b6-b935-af8faf1eef09', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6430f6-e89d-4e89-9fb1-2913dcecedfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:32 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Volume volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 (16adbaf8-74d0-45b6-b935-af8faf1eef09): created successfully Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6430f6-e89d-4e89-9fb1-2913dcecedfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (c9207051-9c32-41e1-9795-dcb4399435be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-477403a9-8991-4145-b1a8-6350485baab2 tempest-VolumesActionsTest-1735593945 None] Created volume successfully. Jul 19 13:13:32 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5" returned: 0 in 0.555s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:32 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5 Jul 19 13:13:32 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:32 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-566f0ac8-0678-4ded-89a5-9c29880f7ba5" returned: 0 in 0.261s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "cinder-quobyte-566f0ac8-0678-4ded-89a5-9c29880f7ba5" released by "delete_volume" :: held 0.883s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Created reservations ['793a3b21-1017-4d99-880c-e4d1b1f97fb2', 'a5b085a6-5118-4c34-b2f4-dd71e4e1eb14', '007d0742-5798-45ee-867c-85ac99da97e0', 'a2d77855-50aa-491f-818a-a0815df96a23'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:32 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:13:32 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-16adbaf8-74d0-45b6-b935-af8faf1eef09-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Lock "cinder-16adbaf8-74d0-45b6-b935-af8faf1eef09-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:33 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.507s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:13:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Deleted volume successfully. Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-quobyte-16adbaf8-74d0-45b6-b935-af8faf1eef09" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-16adbaf8-74d0-45b6-b935-af8faf1eef09" acquired by "delete_volume" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-55508795-ca82-49b5-b616-4004ba08055f tempest-TestServerVolumeAttachScenarioOldVersion-209848098 None] Lock "cinder-566f0ac8-0678-4ded-89a5-9c29880f7ba5-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[067bc156-e06c-4edc-beff-8394e35a2185]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:33 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 Jul 19 13:13:33 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:34 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09" returned: 0 in 0.696s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:34 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09 Jul 19 13:13:34 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:34 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16adbaf8-74d0-45b6-b935-af8faf1eef09" returned: 0 in 0.448s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-16adbaf8-74d0-45b6-b935-af8faf1eef09" released by "delete_volume" :: held 1.208s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5fd16d0b-d4b2-4640-bbf6-51621e353a24 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928" by "attach_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5fd16d0b-d4b2-4640-bbf6-51621e353a24 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928" acquired by "attach_volume" :: waited 0.047s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Created reservations ['9c2ef721-d038-4147-9068-529cbac6d109', '8868bec5-3fa7-408b-85b2-ba377f3ae5f9', '0ba3a01f-b1d4-4015-9079-cef01fef7a85', '096fa702-5115-4bd0-be10-62c8d2eeda5b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:13:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5fd16d0b-d4b2-4640-bbf6-51621e353a24 tempest-VolumesActionsTest-1604717805 None] Attaching volume da192f1b-1b85-45cb-9c79-fb4bc0faf928 to instance 7b7e73f2-64eb-4048-8600-f4b67df2cd3a at mountpoint /dev/vdb on host None. Jul 19 13:13:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5fd16d0b-d4b2-4640-bbf6-51621e353a24 tempest-VolumesActionsTest-1604717805 None] Attach volume completed successfully. Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5fd16d0b-d4b2-4640-bbf6-51621e353a24 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928" released by "attach_volume" :: held 0.206s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:35 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:13:35 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-efd267b0-6c66-469d-b647-611b639d6390 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-detach_volume" by "detach_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-efd267b0-6c66-469d-b647-611b639d6390 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-efd267b0-6c66-469d-b647-611b639d6390 tempest-VolumesActionsTest-1604717805 None] Detaching volume da192f1b-1b85-45cb-9c79-fb4bc0faf928 from instance 7b7e73f2-64eb-4048-8600-f4b67df2cd3a. Jul 19 13:13:35 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.495s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:35 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:13:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Deleted volume successfully. Jul 19 13:13:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a4a0acf1-90e6-4744-8bba-63c8e10c9f2a tempest-VolumesActionsTest-1863149484 None] Lock "cinder-16adbaf8-74d0-45b6-b935-af8faf1eef09-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:35 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-efd267b0-6c66-469d-b647-611b639d6390 tempest-VolumesActionsTest-1604717805 None] Detach volume completed successfully. Jul 19 13:13:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-efd267b0-6c66-469d-b647-611b639d6390 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (1d1508a4-8c9e-445c-a456-69d60d2ecb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0f0318-6ab1-4e74-ab66-fdbc4c104cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0f0318-6ab1-4e74-ab66-fdbc4c104cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1836892125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4ae199-7652-4808-a2da-c292a50ce172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:37Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2f278f-ac2f-4929-86fd-13ab297bb557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2f278f-ac2f-4929-86fd-13ab297bb557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d54ac41-eb66-467f-bcb1-1b2fdfb6a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d54ac41-eb66-467f-bcb1-1b2fdfb6a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4ae199-7652-4808-a2da-c292a50ce172', 'volume_name': 'volume-ed4ae199-7652-4808-a2da-c292a50ce172', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498c9084-f30e-4b86-b4ee-2996a841af38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498c9084-f30e-4b86-b4ee-2996a841af38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97a5193-f0b4-45a6-8285-bc39487bae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:36 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Volume ed4ae199-7652-4808-a2da-c292a50ce172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4ae199-7652-4808-a2da-c292a50ce172', 'volume_size': 1} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1836892125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4ae199-7652-4808-a2da-c292a50ce172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:37Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Creating volume ed4ae199-7652-4808-a2da-c292a50ce172 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:13:36 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:13:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:37 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 1073741824 Jul 19 13:13:37 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:37 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 1073741824" returned: 0 in 0.663s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:37 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 Jul 19 13:13:37 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:38 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172" returned: 0 in 0.391s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97a5193-f0b4-45a6-8285-bc39487bae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4ae199-7652-4808-a2da-c292a50ce172', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672d0f86-f3a8-4558-a1dc-ea720c53f029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:38 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Volume volume-ed4ae199-7652-4808-a2da-c292a50ce172 (ed4ae199-7652-4808-a2da-c292a50ce172): created successfully Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672d0f86-f3a8-4558-a1dc-ea720c53f029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (1d1508a4-8c9e-445c-a456-69d60d2ecb19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e703160f-235d-4773-87cf-3a780def6fbe tempest-VolumesActionsTest-1735593945 None] Created volume successfully. Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-ed4ae199-7652-4808-a2da-c292a50ce172-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Lock "cinder-ed4ae199-7652-4808-a2da-c292a50ce172-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-quobyte-ed4ae199-7652-4808-a2da-c292a50ce172" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:13:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-ed4ae199-7652-4808-a2da-c292a50ce172" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:13:39 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66048dc7-5d81-4a82-8711-5d630a0491ae]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:39 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 Jul 19 13:13:39 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:39 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172" returned: 0 in 0.609s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:39 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172 Jul 19 13:13:39 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:40 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ed4ae199-7652-4808-a2da-c292a50ce172" returned: 0 in 0.362s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-ed4ae199-7652-4808-a2da-c292a50ce172" released by "delete_volume" :: held 1.045s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Created reservations ['d0a44e4b-3dd8-4853-8913-ee97b0384bfd', 'b3756ad1-ca8e-481c-bb99-d4daf857e959', '556f3351-7f3f-4494-9d96-d7107e91994d', '7df77aaf-2a6b-4bea-a756-2ba44ea95d10'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-f5914e80-5b74-4d5f-b75f-5f1ce76ab8ff req-3107501c-bd1d-4a22-8485-7e68c6577365 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-f5914e80-5b74-4d5f-b75f-5f1ce76ab8ff req-3107501c-bd1d-4a22-8485-7e68c6577365 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:40 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:13:40 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-f5914e80-5b74-4d5f-b75f-5f1ce76ab8ff req-3107501c-bd1d-4a22-8485-7e68c6577365 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-f5914e80-5b74-4d5f-b75f-5f1ce76ab8ff req-3107501c-bd1d-4a22-8485-7e68c6577365 tempest-TestInstancesWithCinderVolumes-215654207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-2b34463b-c102-4cba-99f5-67c3629bc1c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a87aa18-2dd5-46f4-b442-1defefd43a4f', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:13:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-f5914e80-5b74-4d5f-b75f-5f1ce76ab8ff req-3107501c-bd1d-4a22-8485-7e68c6577365 tempest-TestInstancesWithCinderVolumes-215654207 None] attachment_update completed successfully. Jul 19 13:13:40 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.351s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:13:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Deleted volume successfully. Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5c6e0677-e318-42a5-b57b-b1a924c602ee tempest-VolumesActionsTest-1863149484 None] Lock "cinder-ed4ae199-7652-4808-a2da-c292a50ce172-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d7b8b9-41cd-4064-beff-4226da3602e3]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:41 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:13:41 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:41 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.405s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd3391-cc0e-4ec7-a87c-9aea10c71c6f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:41 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:13:41 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:41 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.457s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.152e5c18-df3e-467b-9ba5-f092c11dd11cjnvys9rm.img {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:13:41 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.152e5c18-df3e-467b-9ba5-f092c11dd11cjnvys9rm.img Jul 19 13:13:41 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (eb5a9be4-5eef-4358-b584-069ef8c85751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdbe5ff-ca32-4a4b-a7d0-36cbcad1f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdbe5ff-ca32-4a4b-a7d0-36cbcad1f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481470614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e629270-a770-4716-a63c-758c1ca13814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:42Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba52b321-29f3-4eb9-8663-8a65d052214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba52b321-29f3-4eb9-8663-8a65d052214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea397fc-8b85-44ff-aa6b-5e5f3a218ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea397fc-8b85-44ff-aa6b-5e5f3a218ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e629270-a770-4716-a63c-758c1ca13814', 'volume_name': 'volume-8e629270-a770-4716-a63c-758c1ca13814', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c1022-0567-4ed6-b71e-d52eb8fa0876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c1022-0567-4ed6-b71e-d52eb8fa0876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2b105a-787f-4e71-8650-c0fdc7d1289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:13:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Volume 8e629270-a770-4716-a63c-758c1ca13814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e629270-a770-4716-a63c-758c1ca13814', 'volume_size': 1} Jul 19 13:13:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:13:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:13:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:13:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:13:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:13:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:42 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:13:42 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:43 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.865s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:43 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:13:43 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:13:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:13:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:13:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-9072cd20-42bf-4b99-9c30-9a719fa738cc req-50aea38b-8162-4c04-981a-fa885b18615f tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:13:47 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.152e5c18-df3e-467b-9ba5-f092c11dd11cjnvys9rm.img" returned: 0 in 5.235s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:47 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d8bcc8-1b74-4c87-9db5-b6c3df4b4191]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:13:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:13:47 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:13:47 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:13:47 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 19 13:13:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.553s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:13:47 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.152e5c18-df3e-467b-9ba5-f092c11dd11cjnvys9rm.img {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:13:47 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Converted 1024.00 MB image at 195.56 MB/s Jul 19 13:13:47 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] 152e5c18-df3e-467b-9ba5-f092c11dd11c was raw, no need to convert to raw {{(pid=87305) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 19 13:13:54 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=78,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:13:57 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=85,cinder:UPDATE=70,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.093s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Uploaded volume to glance image-id: 152e5c18-df3e-467b-9ba5-f092c11dd11c. {{(pid=87305) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.062s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481470614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e629270-a770-4716-a63c-758c1ca13814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:13:42Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Creating volume 8e629270-a770-4716-a63c-758c1ca13814 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:09 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:09 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 1073741824 Jul 19 13:14:09 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:09 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b48b1087-398e-4ef3-8f88-c26af1d5c2e4 tempest-VolumesActionsTest-1604717805 None] Copy volume to image completed successfully. Jul 19 13:14:09 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 1073741824" returned: 0 in 0.544s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:09 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 Jul 19 13:14:09 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:09 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814" returned: 0 in 0.297s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-9072cd20-42bf-4b99-9c30-9a719fa738cc req-50aea38b-8162-4c04-981a-fa885b18615f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.190s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2b105a-787f-4e71-8650-c0fdc7d1289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e629270-a770-4716-a63c-758c1ca13814', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba12952-8461-4ffe-9b8b-6e8d9bc6b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-9072cd20-42bf-4b99-9c30-9a719fa738cc req-50aea38b-8162-4c04-981a-fa885b18615f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Volume volume-8e629270-a770-4716-a63c-758c1ca13814 (8e629270-a770-4716-a63c-758c1ca13814): created successfully Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba12952-8461-4ffe-9b8b-6e8d9bc6b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (eb5a9be4-5eef-4358-b584-069ef8c85751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:10 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9b224834-6d70-4318-8a58-7bfd190cc106 tempest-VolumesActionsTest-1735593945 None] Created volume successfully. Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-9072cd20-42bf-4b99-9c30-9a719fa738cc req-50aea38b-8162-4c04-981a-fa885b18615f tempest-TestInstancesWithCinderVolumes-215654207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18a7a21d-aaeb-4081-8414-0aaeb8fb0cd6', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:14:10 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-9072cd20-42bf-4b99-9c30-9a719fa738cc req-50aea38b-8162-4c04-981a-fa885b18615f tempest-TestInstancesWithCinderVolumes-215654207 None] attachment_update completed successfully. Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-8e629270-a770-4716-a63c-758c1ca13814-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-8e629270-a770-4716-a63c-758c1ca13814-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Acquiring lock "cinder-quobyte-8e629270-a770-4716-a63c-758c1ca13814" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-8e629270-a770-4716-a63c-758c1ca13814" acquired by "delete_volume" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa7a05-0223-4df8-905f-1534ae8bc135]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:11 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 Jul 19 13:14:11 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6527420-9a11-44d8-867a-e5b1666bc014]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:11 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:14:11 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:11 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814" returned: 0 in 0.558s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:11 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814 Jul 19 13:14:11 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:11 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.478s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:11 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8e629270-a770-4716-a63c-758c1ca13814" returned: 0 in 0.267s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[20020b23-68bf-43a1-9eeb-c5f987a43f7f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-quobyte-8e629270-a770-4716-a63c-758c1ca13814" released by "delete_volume" :: held 0.915s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:11 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Created reservations ['c80a71c7-b165-45e0-9dcb-7866548c2429', '119cb495-6fc5-403a-8541-b16d68c617bd', 'd05e29cb-e4a0-4a54-8edc-95110e312dfb', '0caef089-6143-4530-a9e5-198ad70a3891'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:14:11 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:14:11 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:12 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:14:12 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:12 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.595s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:12 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img Jul 19 13:14:12 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:12 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.358s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:14:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Deleted volume successfully. Jul 19 13:14:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db2fb5c1-fd4d-4343-9e7f-416cb7feef60 tempest-VolumesActionsTest-1863149484 None] Lock "cinder-8e629270-a770-4716-a63c-758c1ca13814-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (c6302305-cbb4-47cd-a24c-79d72ec1c4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90580de0-b19d-41d5-834f-d680c1248c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90580de0-b19d-41d5-834f-d680c1248c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012762134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0412b0-69c2-4930-82d8-a67d9b5aab5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:15Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77eaf25-b9f8-469d-84a7-593f94fd168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77eaf25-b9f8-469d-84a7-593f94fd168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965ca401-3902-4c64-881d-3699f67284f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965ca401-3902-4c64-881d-3699f67284f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0412b0-69c2-4930-82d8-a67d9b5aab5b', 'volume_name': 'volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0b4c4e-6808-4839-8209-375a821c68e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0b4c4e-6808-4839-8209-375a821c68e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b309d0eb-1da3-45eb-b75b-b07f057c242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Volume 9d0412b0-69c2-4930-82d8-a67d9b5aab5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b', 'volume_size': 1} Jul 19 13:14:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:18 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img" returned: 0 in 5.900s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-b5a5c95d-7250-471d-ac95-cb688095e27c req-46144aaf-cc3a-4d1f-926c-7682bc90a7f1 tempest-TestInstancesWithCinderVolumes-215654207 None] Terminate volume connection completed successfully. Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-b5a5c95d-7250-471d-ac95-cb688095e27c req-46144aaf-cc3a-4d1f-926c-7682bc90a7f1 tempest-TestInstancesWithCinderVolumes-215654207 None] Deleting attachment 2a87aa18-2dd5-46f4-b442-1defefd43a4f. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8bcec7-c029-48ca-b1ef-3397e305abf5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:18 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:14:18 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "cinder-2b34463b-c102-4cba-99f5-67c3629bc1c2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-2b34463b-c102-4cba-99f5-67c3629bc1c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:18 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.575s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:14:18 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Converted 1024.00 MB image at 173.52 MB/s Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "cinder-quobyte-2b34463b-c102-4cba-99f5-67c3629bc1c2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] d9dac7ae-3912-4195-9641-829a45bbd935 was raw, converting to qcow2 {{(pid=87305) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-quobyte-2b34463b-c102-4cba-99f5-67c3629bc1c2" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be76fccb-d9f3-4ed2-908c-2595e485807f]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[926e398c-c6c8-4695-b4d6-560355507c00]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:19 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img Jul 19 13:14:19 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:19 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 Jul 19 13:14:19 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:19 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img" returned: 0 in 0.408s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:19 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2" returned: 0 in 0.451s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:19 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2 Jul 19 13:14:19 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:19 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img Jul 19 13:14:19 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:19 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2b34463b-c102-4cba-99f5-67c3629bc1c2" returned: 0 in 0.320s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:19 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img" returned: 1 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img /opt/stack/data/cinder/conversion/vol_upload_9r7ll_or {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-quobyte-2b34463b-c102-4cba-99f5-67c3629bc1c2" released by "delete_volume" :: held 0.850s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:19 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img /opt/stack/data/cinder/conversion/vol_upload_9r7ll_or Jul 19 13:14:19 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:19 devstack cinder-volume[87305]: WARNING cinder.quota [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538965737-688110879 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538965737-688110879, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:14:19 devstack cinder-volume[87305]: WARNING cinder.quota [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538965737-688110879 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538965737-688110879, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Created reservations ['e1f1bafb-6dff-4b0b-8f9d-14684a964a72', 'aee9bf36-7144-41ad-8b8d-c441b0367f57', '7333335d-51a6-4b74-95c2-931aba26c4e7', 'be641aa9-404a-4ba6-9c70-f9993033233e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:19 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:14:19 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:20 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img /opt/stack/data/cinder/conversion/vol_upload_9r7ll_or" returned: 0 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Image conversion details: src /opt/stack/data/cinder/conversion/da192f1b-1b85-45cb-9c79-fb4bc0faf928.temp_image.d9dac7ae-3912-4195-9641-829a45bbd935bj0kn6os.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9r7ll_or {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:14:20 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ba1013-4c53-460e-b69d-a8593a845e3e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9r7ll_or {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:20 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9r7ll_or Jul 19 13:14:20 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:20 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.409s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:14:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Deleted volume successfully. Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-aaf79daa-9b6b-4812-b2c6-5b2466f80b51 tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-2b34463b-c102-4cba-99f5-67c3629bc1c2-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:20 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9r7ll_or" returned: 0 in 0.507s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Flow 'volume_create_manager' (48d03c45-6a5a-4552-995f-77706de433e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f08d33-3b32-45ed-a522-a9884eac04da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f08d33-3b32-45ed-a522-a9884eac04da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-233144829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c559c66f-0baa-4520-956c-6b95620cf5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1c2bfce3744f38a1c724f034e119c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:22Z,use_quota=True,user_id='6d10d6c08f9b4fe19dccdfc1b717556f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee032975-2f54-41f3-8f69-5aeb5ad1d7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee032975-2f54-41f3-8f69-5aeb5ad1d7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17dc7706-2b39-4ebc-beb8-0cb8419433ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17dc7706-2b39-4ebc-beb8-0cb8419433ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c559c66f-0baa-4520-956c-6b95620cf5d1', 'volume_name': 'volume-c559c66f-0baa-4520-956c-6b95620cf5d1', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a95c8b0-b5a7-48b4-989b-3250f460e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a95c8b0-b5a7-48b4-989b-3250f460e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d58fc79-d633-4155-9208-dc70c2097f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:22 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Volume c559c66f-0baa-4520-956c-6b95620cf5d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c559c66f-0baa-4520-956c-6b95620cf5d1', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Trying to clone c559c66f-0baa-4520-956c-6b95620cf5d1 from image 97bba3f0-2950-4456-be46-6a90be277718 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.503s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Uploaded volume to glance image-id: d9dac7ae-3912-4195-9641-829a45bbd935. {{(pid=87305) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.719s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012762134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0412b0-69c2-4930-82d8-a67d9b5aab5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b47a23f087740d9bd265d3b4b5ca371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:15Z,use_quota=True,user_id='84ca424dbe5e42afbc9a3e9253bd1ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Creating volume 9d0412b0-69c2-4930-82d8-a67d9b5aab5b {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:22 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:22 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b 1073741824 Jul 19 13:14:22 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0900e621-2cda-4fe9-b9f9-9f4357935921 tempest-VolumesActionsTest-1604717805 None] Copy volume to image completed successfully. Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:14:22 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Image download 20.69 MB at 20.69 MB/s Jul 19 13:14:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-c30d7889-1481-462a-91e4-cf7a72cdd311 req-48e8244e-3f85-4300-9830-653f4e7d703b tempest-TestInstancesWithCinderVolumes-215654207 None] Terminate volume connection completed successfully. Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-c30d7889-1481-462a-91e4-cf7a72cdd311 req-48e8244e-3f85-4300-9830-653f4e7d703b tempest-TestInstancesWithCinderVolumes-215654207 None] Deleting attachment 18a7a21d-aaeb-4081-8414-0aaeb8fb0cd6. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6af9a0-81b5-44a5-84fa-62068f90ecbc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:23 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD Jul 19 13:14:23 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:23 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b 1073741824" returned: 0 in 0.519s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:23 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b Jul 19 13:14:23 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:23 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 is fetched for user 6d10d6c08f9b4fe19dccdfc1b717556f. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eec9f2-dfe3-454a-8a1a-e48c2f2c2b3e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:23 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:23 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD Jul 19 13:14:23 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b309d0eb-1da3-45eb-b75b-b07f057c242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e9d5e-19e8-4f8d-85d7-85150a28cf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:23 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Volume volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b (9d0412b0-69c2-4930-82d8-a67d9b5aab5b): created successfully Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e9d5e-19e8-4f8d-85d7-85150a28cf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Flow 'volume_create_manager' (c6302305-cbb4-47cd-a24c-79d72ec1c4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "cinder-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d3c42ea1-f1bc-4d59-b5ea-de7fef0b4dd6 tempest-VolumesActionsTest-1735593945 None] Created volume successfully. Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "cinder-quobyte-da192f1b-1b85-45cb-9c79-fb4bc0faf928" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "cinder-quobyte-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-quobyte-da192f1b-1b85-45cb-9c79-fb4bc0faf928" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-quobyte-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e" acquired by "delete_volume" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4240ba-13a3-4988-9b82-7cd45b052156]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1567d78d-7aa0-4bbb-ae80-cf9136381a94]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:23 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-233144829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c559c66f-0baa-4520-956c-6b95620cf5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1c2bfce3744f38a1c724f034e119c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:22Z,use_quota=True,user_id='6d10d6c08f9b4fe19dccdfc1b717556f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Creating volume c559c66f-0baa-4520-956c-6b95620cf5d1 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:23 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:23 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 1073741824 Jul 19 13:14:23 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:23 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:14:23 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:23 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e Jul 19 13:14:23 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:24 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:24 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.465s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e" returned: 0 in 0.458s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:24 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928 Jul 19 13:14:24 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:24 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e Jul 19 13:14:24 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:24 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 1073741824" returned: 0 in 0.547s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:24 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 Jul 19 13:14:24 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:24 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da192f1b-1b85-45cb-9c79-fb4bc0faf928" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-quobyte-da192f1b-1b85-45cb-9c79-fb4bc0faf928" released by "delete_volume" :: held 0.893s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:24 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-quobyte-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e" released by "delete_volume" :: held 0.902s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Created reservations ['98b1d6ea-eba5-43d9-b276-61cc8b664e73', 'bcf025bf-2e6c-4b81-99fb-2014cbfef219', 'ef8be78e-5ce9-4a70-ad32-d3081adc7afd', '2f66bb00-0c62-4843-82b2-80e281515175'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:14:24 devstack cinder-volume[87305]: WARNING cinder.quota [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511420902-168974361 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511420902-168974361, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:14:24 devstack cinder-volume[87305]: WARNING cinder.quota [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511420902-168974361 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511420902-168974361, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Created reservations ['11bb7b0b-5369-48d9-b51a-5eff1ddbe4ce', 'ae6827e9-7b57-4f26-a663-6c082cbb12b5', 'b082dee4-ca63-453e-8179-6327427dd008', 'b657db10-ba7d-48f3-953d-90947bf88cb9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:24 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1" returned: 0 in 0.493s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:25 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:14:25 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Attempting download of 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume c559c66f-0baa-4520-956c-6b95620cf5d1. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:25 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:14:25 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f0f983-cd39-43dc-919f-864b8b2eb8f8]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_997awc87 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:25 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.401s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Acquiring lock "cinder-9d0412b0-69c2-4930-82d8-a67d9b5aab5b-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:25 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_997awc87 Jul 19 13:14:25 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:14:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Deleted volume successfully. Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Lock "cinder-9d0412b0-69c2-4930-82d8-a67d9b5aab5b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a068156b-8f74-4fb5-b87e-0804fc9cb663 tempest-VolumesActionsTest-1604717805 None] Lock "cinder-da192f1b-1b85-45cb-9c79-fb4bc0faf928-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Acquiring lock "cinder-quobyte-9d0412b0-69c2-4930-82d8-a67d9b5aab5b" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:25 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Lock "cinder-quobyte-9d0412b0-69c2-4930-82d8-a67d9b5aab5b" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Deleted volume successfully. Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a8a0a-4c05-464f-a44d-e40b16a61454]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-33cdf70f-eff8-4c87-9624-6957620c068f tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-4d0fc90c-0ea8-45b1-86fc-20193a9d8b2e-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:25 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_997awc87" returned: 0 in 0.523s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_997awc87 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:25 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b Jul 19 13:14:25 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:25 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_997awc87 Jul 19 13:14:25 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:25 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b" returned: 0 in 0.437s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:26 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b Jul 19 13:14:26 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:26 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_997awc87" returned: 1 in 0.455s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_997awc87' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f145c37-431e-453a-b297-e5c80fe3e04c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:26 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD Jul 19 13:14:26 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:26 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9d0412b0-69c2-4930-82d8-a67d9b5aab5b" returned: 0 in 0.313s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Lock "cinder-quobyte-9d0412b0-69c2-4930-82d8-a67d9b5aab5b" released by "delete_volume" :: held 0.808s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Created reservations ['81b8f7a6-d37f-4c91-87c5-5847e81be67e', '28ab4a6d-bce0-4f47-99e1-0c082418af79', '45ecdbcd-3f9b-44b7-a35a-9a97b5c689cf', '8a66edbb-1be7-4b39-9038-d5d280bc6b52'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:26 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] 97bba3f0-2950-4456-be46-6a90be277718 was qcow2, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:26 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:14:26 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:26 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 Jul 19 13:14:26 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:26 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.395s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:14:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Deleted volume successfully. Jul 19 13:14:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24a9640f-c431-4be9-b0de-16713068188a tempest-VolumesActionsTest-1735593945 None] Lock "cinder-9d0412b0-69c2-4930-82d8-a67d9b5aab5b-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:29 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1" returned: 0 in 2.636s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_2epqced4devstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:14:29 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Converted 112.00 MB image at 42.47 MB/s Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:29 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 1G Jul 19 13:14:29 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:29 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 1G" returned: 0 in 0.348s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Downloaded image 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume c559c66f-0baa-4520-956c-6b95620cf5d1 successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 for user 6d10d6c08f9b4fe19dccdfc1b717556f is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Marking volume c559c66f-0baa-4520-956c-6b95620cf5d1 as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Copying metadata from image 97bba3f0-2950-4456-be46-6a90be277718 to c559c66f-0baa-4520-956c-6b95620cf5d1. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Creating volume glance metadata for volume c559c66f-0baa-4520-956c-6b95620cf5d1 backed by image 97bba3f0-2950-4456-be46-6a90be277718 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d58fc79-d633-4155-9208-dc70c2097f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c559c66f-0baa-4520-956c-6b95620cf5d1', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1138917-0618-4ec6-aead-e07aaea7769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:29 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Volume volume-c559c66f-0baa-4520-956c-6b95620cf5d1 (c559c66f-0baa-4520-956c-6b95620cf5d1): created successfully Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1138917-0618-4ec6-aead-e07aaea7769b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Flow 'volume_create_manager' (48d03c45-6a5a-4552-995f-77706de433e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2defa585-5dc8-4ea7-b853-d584122aa39a tempest-TestShelveInstance-2000878765 None] Created volume successfully. Jul 19 13:14:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-d85e7e2e-e81d-41cc-93d9-31912ec6c997 req-73a54b86-6bdf-4e6b-99d3-4c5bd8a5f9ce tempest-TestInstancesWithCinderVolumes-215654207 None] Terminate volume connection completed successfully. Jul 19 13:14:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-d85e7e2e-e81d-41cc-93d9-31912ec6c997 req-73a54b86-6bdf-4e6b-99d3-4c5bd8a5f9ce tempest-TestInstancesWithCinderVolumes-215654207 None] Deleting attachment 2283614d-7d54-47f2-8c67-68ec914fbcbe. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:14:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "cinder-8fda8cb3-0200-4c4e-97a1-a1053f5c254e-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-8fda8cb3-0200-4c4e-97a1-a1053f5c254e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "cinder-quobyte-8fda8cb3-0200-4c4e-97a1-a1053f5c254e" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:14:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-quobyte-8fda8cb3-0200-4c4e-97a1-a1053f5c254e" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:14:31 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2fa3b5-9505-495b-84df-d468dcb734a7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:14:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:32 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e Jul 19 13:14:32 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:32 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:32 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e Jul 19 13:14:32 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:32 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fda8cb3-0200-4c4e-97a1-a1053f5c254e" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-quobyte-8fda8cb3-0200-4c4e-97a1-a1053f5c254e" released by "delete_volume" :: held 0.799s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:32 devstack cinder-volume[87305]: WARNING cinder.quota [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748221508-1154480619 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748221508-1154480619, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:14:32 devstack cinder-volume[87305]: WARNING cinder.quota [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748221508-1154480619 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748221508-1154480619, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Created reservations ['8ffb0625-4b02-4f70-b440-d0d55bdb434a', '08e3843d-7a99-4a47-bd90-fe6c3f748ad5', 'ee654d1f-7ef3-427f-b530-da515b21660b', 'acad8512-6382-46e8-b3d6-d1140cd2a0ba'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:32 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:14:32 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:33 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.310s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:33 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:14:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Deleted volume successfully. Jul 19 13:14:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ac903fd9-8bb8-4216-a79d-2aa75e70c8dd tempest-TestInstancesWithCinderVolumes-215654207 None] Lock "cinder-8fda8cb3-0200-4c4e-97a1-a1053f5c254e-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:14:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-1216ac1d-5d58-42ee-85b0-7b8da321eedf req-ebefc76d-fd99-43a8-a0cc-09354b0a9d31 tempest-TestShelveInstance-2000878765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-1216ac1d-5d58-42ee-85b0-7b8da321eedf req-ebefc76d-fd99-43a8-a0cc-09354b0a9d31 tempest-TestShelveInstance-2000878765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-1216ac1d-5d58-42ee-85b0-7b8da321eedf req-ebefc76d-fd99-43a8-a0cc-09354b0a9d31 tempest-TestShelveInstance-2000878765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-1216ac1d-5d58-42ee-85b0-7b8da321eedf req-ebefc76d-fd99-43a8-a0cc-09354b0a9d31 tempest-TestShelveInstance-2000878765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-c559c66f-0baa-4520-956c-6b95620cf5d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17963d91-2490-4f6b-91a3-eb637e93f2c8', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:14:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-1216ac1d-5d58-42ee-85b0-7b8da321eedf req-ebefc76d-fd99-43a8-a0cc-09354b0a9d31 tempest-TestShelveInstance-2000878765 None] attachment_update completed successfully. Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Flow 'volume_create_manager' (7815e590-acac-411a-ac5f-1bbf6d64ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dc2fb8-1cf1-4565-b92a-25629ed26531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dc2fb8-1cf1-4565-b92a-25629ed26531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1014767657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdec9fc3-9925-492f-9e24-0b44d0dfa865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542d262226e94eb7a4845a557e14805d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:40Z,use_quota=True,user_id='7bf1d93257c74ea5ab291cf9340082a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89df45af-b87c-488e-be60-25bce613a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89df45af-b87c-488e-be60-25bce613a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad64f20-192b-4dd2-a0c3-73d6a4c0756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad64f20-192b-4dd2-a0c3-73d6a4c0756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdec9fc3-9925-492f-9e24-0b44d0dfa865', 'volume_name': 'volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521034b2-0952-4e2f-9419-08067fcac7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521034b2-0952-4e2f-9419-08067fcac7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080c403a-0b80-4b79-8341-a5c18ffb149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Volume cdec9fc3-9925-492f-9e24-0b44d0dfa865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865', 'volume_size': 1} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1014767657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdec9fc3-9925-492f-9e24-0b44d0dfa865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542d262226e94eb7a4845a557e14805d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:40Z,use_quota=True,user_id='7bf1d93257c74ea5ab291cf9340082a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Creating volume cdec9fc3-9925-492f-9e24-0b44d0dfa865 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:40 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:40 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 1073741824 Jul 19 13:14:40 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:41 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 1073741824" returned: 0 in 0.675s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:41 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 Jul 19 13:14:41 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:41 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865" returned: 0 in 0.591s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080c403a-0b80-4b79-8341-a5c18ffb149a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74467230-d9ca-492d-a7f7-576e5582e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Volume volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 (cdec9fc3-9925-492f-9e24-0b44d0dfa865): created successfully Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74467230-d9ca-492d-a7f7-576e5582e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Flow 'volume_create_manager' (7815e590-acac-411a-ac5f-1bbf6d64ae05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-11db700a-b52b-4598-b7d1-ad47e0664ba7 tempest-VolumesNegativeTest-525089979 None] Created volume successfully. Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:42 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:14:42 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:42 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.485s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:14:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Flow 'volume_create_manager' (f1fb7e46-0507-406e-97fb-9bfda8576040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30083e1-e562-4675-b677-c1b22e361613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30083e1-e562-4675-b677-c1b22e361613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253535153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ae158c-753f-4f54-9b2a-100ae1894795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40489c8e792e4c12bc5323403e901222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:45Z,use_quota=True,user_id='ee5614c3eb0944afb592655845cc9272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b2e71b-e7cd-41bf-8a7b-abc660f4044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b2e71b-e7cd-41bf-8a7b-abc660f4044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4857e9df-8873-45c0-bb29-c364c7ca3e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4857e9df-8873-45c0-bb29-c364c7ca3e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ae158c-753f-4f54-9b2a-100ae1894795', 'volume_name': 'volume-19ae158c-753f-4f54-9b2a-100ae1894795', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d631930-d775-4254-aa09-3fd710312ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d631930-d775-4254-aa09-3fd710312ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c42051-1283-48d4-b293-2b0b22681fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:45 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Volume 19ae158c-753f-4f54-9b2a-100ae1894795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ae158c-753f-4f54-9b2a-100ae1894795', 'volume_size': 1} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253535153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ae158c-753f-4f54-9b2a-100ae1894795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40489c8e792e4c12bc5323403e901222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:45Z,use_quota=True,user_id='ee5614c3eb0944afb592655845cc9272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Creating volume 19ae158c-753f-4f54-9b2a-100ae1894795 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:45 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:45 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 1073741824 Jul 19 13:14:45 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:46 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 1073741824" returned: 0 in 0.997s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:46 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 Jul 19 13:14:46 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:47 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795" returned: 0 in 0.640s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c42051-1283-48d4-b293-2b0b22681fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ae158c-753f-4f54-9b2a-100ae1894795', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde63bdc-a8d9-45a4-9fc2-d1dc86303793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:47 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Volume volume-19ae158c-753f-4f54-9b2a-100ae1894795 (19ae158c-753f-4f54-9b2a-100ae1894795): created successfully Jul 19 13:14:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde63bdc-a8d9-45a4-9fc2-d1dc86303793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Flow 'volume_create_manager' (f1fb7e46-0507-406e-97fb-9bfda8576040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-efbb1dfd-13e6-4012-b50f-05a9e545a34b tempest-VolumesListAdminTestJSON-1365189898 None] Created volume successfully. Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Flow 'volume_create_manager' (ad14fc0c-1f59-447a-b691-439c2748c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861aa6a2-4dfe-4c21-b266-da1d57f4ee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861aa6a2-4dfe-4c21-b266-da1d57f4ee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64006739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8b22f0-86ff-49de-836e-ead7d97c27e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40489c8e792e4c12bc5323403e901222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:50Z,use_quota=True,user_id='ee5614c3eb0944afb592655845cc9272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b502b162-1cb0-4362-9771-bf01c9b72932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b502b162-1cb0-4362-9771-bf01c9b72932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0456cf2a-2735-47eb-b5e3-4b5d93684aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0456cf2a-2735-47eb-b5e3-4b5d93684aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce8b22f0-86ff-49de-836e-ead7d97c27e8', 'volume_name': 'volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229d6f4b-875e-4282-b1a5-912f5eadf879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229d6f4b-875e-4282-b1a5-912f5eadf879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da73b24f-0453-45a3-9da1-f7688542c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:49 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Volume ce8b22f0-86ff-49de-836e-ead7d97c27e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8', 'volume_size': 1} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64006739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8b22f0-86ff-49de-836e-ead7d97c27e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40489c8e792e4c12bc5323403e901222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:50Z,use_quota=True,user_id='ee5614c3eb0944afb592655845cc9272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Creating volume ce8b22f0-86ff-49de-836e-ead7d97c27e8 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:49 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:49 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 1073741824 Jul 19 13:14:49 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:50 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 1073741824" returned: 0 in 0.770s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:50 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 Jul 19 13:14:50 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:50 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8" returned: 0 in 0.332s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da73b24f-0453-45a3-9da1-f7688542c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b961da6-926a-4d0f-a61c-791913445d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:51 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Volume volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 (ce8b22f0-86ff-49de-836e-ead7d97c27e8): created successfully Jul 19 13:14:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b961da6-926a-4d0f-a61c-791913445d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Flow 'volume_create_manager' (ad14fc0c-1f59-447a-b691-439c2748c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:51 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-02912a26-88df-4013-9766-bae44f84fefb tempest-VolumesListAdminTestJSON-1365189898 None] Created volume successfully. Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Flow 'volume_create_manager' (26b8d833-9204-47ba-a9ae-a58e9b5731d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cafbf12-6d34-473b-9525-5d65d0dbac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cafbf12-6d34-473b-9525-5d65d0dbac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2113710092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9901e8a-32ef-4ba5-a1f9-517a359f3935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40489c8e792e4c12bc5323403e901222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:53Z,use_quota=True,user_id='ee5614c3eb0944afb592655845cc9272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048ed66-96b7-4b8c-b726-d495c6c6b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048ed66-96b7-4b8c-b726-d495c6c6b191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee7d2c7-a748-4715-9a7e-a465c1c7cf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee7d2c7-a748-4715-9a7e-a465c1c7cf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9901e8a-32ef-4ba5-a1f9-517a359f3935', 'volume_name': 'volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9771a-a0e8-441c-86a1-7dd00432efe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9771a-a0e8-441c-86a1-7dd00432efe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af38640-d933-425d-976e-539cc55e6f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:53 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Volume d9901e8a-32ef-4ba5-a1f9-517a359f3935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935', 'volume_size': 1} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2113710092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9901e8a-32ef-4ba5-a1f9-517a359f3935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40489c8e792e4c12bc5323403e901222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:53Z,use_quota=True,user_id='ee5614c3eb0944afb592655845cc9272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Creating volume d9901e8a-32ef-4ba5-a1f9-517a359f3935 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:53 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:53 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 1073741824 Jul 19 13:14:53 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:54 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 1073741824" returned: 0 in 0.724s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:54 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 Jul 19 13:14:54 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (ff5cb7c8-baa1-4d36-a6e4-eb5430cc3479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f116949e-833a-471c-b887-1ac855525d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f116949e-833a-471c-b887-1ac855525d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578607237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:54Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91a0ab2-567d-4db9-9709-c27f464600d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91a0ab2-567d-4db9-9709-c27f464600d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ed863a-0d61-42f3-adcb-c9b22cc7ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ed863a-0d61-42f3-adcb-c9b22cc7ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae', 'volume_name': 'volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3646c3cb-ae24-4e67-807c-493f520f2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3646c3cb-ae24-4e67-807c-493f520f2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532b7408-a930-4388-820a-c8a00efefdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:54 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Volume 4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae', 'volume_size': 1} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:54 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935" returned: 0 in 0.447s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578607237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:54Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Creating volume 4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:54 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:54 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae 1073741824 Jul 19 13:14:54 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af38640-d933-425d-976e-539cc55e6f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40514ee4-5172-4c50-8a5c-3674551ae48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:54 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Volume volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 (d9901e8a-32ef-4ba5-a1f9-517a359f3935): created successfully Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40514ee4-5172-4c50-8a5c-3674551ae48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Flow 'volume_create_manager' (26b8d833-9204-47ba-a9ae-a58e9b5731d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a14128fb-6082-4c85-b5a7-b10baba322e5 tempest-VolumesListAdminTestJSON-1365189898 None] Created volume successfully. Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (d977e6db-07ed-4f1f-9272-bab4e6f86cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab913e06-84a2-4e05-8f3b-b160be60023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab913e06-84a2-4e05-8f3b-b160be60023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1532227498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e4bea6-9dd8-4cf5-bb10-375dfc97a9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:55Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5d9935-7e1c-4d22-af2b-51b3c55b1788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5d9935-7e1c-4d22-af2b-51b3c55b1788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baeb423e-834c-4716-b3d9-e4e0429f8ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baeb423e-834c-4716-b3d9-e4e0429f8ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e4bea6-9dd8-4cf5-bb10-375dfc97a9de', 'volume_name': 'volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b3037e-9230-4cb6-9e02-09f9160f5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b3037e-9230-4cb6-9e02-09f9160f5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fc0d76-707a-4048-a333-667a77d5af6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:55 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Volume 80e4bea6-9dd8-4cf5-bb10-375dfc97a9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de', 'volume_size': 1} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:55 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae 1073741824" returned: 0 in 1.039s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:55 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae Jul 19 13:14:55 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:56 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae" returned: 0 in 0.749s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1532227498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e4bea6-9dd8-4cf5-bb10-375dfc97a9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:55Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Creating volume 80e4bea6-9dd8-4cf5-bb10-375dfc97a9de {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:56 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532b7408-a930-4388-820a-c8a00efefdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa3029d-a7a0-4be5-8b2f-e72165826389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:56 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Volume volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae (4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae): created successfully Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa3029d-a7a0-4be5-8b2f-e72165826389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (ff5cb7c8-baa1-4d36-a6e4-eb5430cc3479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:56 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de 1073741824 Jul 19 13:14:56 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:56 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-514ac600-ddc0-4325-926a-a1c4d277b22a tempest-CreateVolumesFromImageTest-1691181063 None] Created volume successfully. Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (9ee01ac4-d73e-4a8e-8dbe-f7fbc7a617f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b22c0e8-e6d3-4790-9046-24003a636e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b22c0e8-e6d3-4790-9046-24003a636e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878584522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0dc146-06a5-41cb-83c8-4a6f33f4beab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:57Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d1b803-e601-46e8-a9a5-36451717913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d1b803-e601-46e8-a9a5-36451717913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c01968-32e1-48ab-ba5f-7441d0d89dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c01968-32e1-48ab-ba5f-7441d0d89dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0dc146-06a5-41cb-83c8-4a6f33f4beab', 'volume_name': 'volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ea8140-0bd5-474d-8ef2-44385c6b2656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ea8140-0bd5-474d-8ef2-44385c6b2656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6cefd0-5957-42ef-9b0d-90efc97c03bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Volume ac0dc146-06a5-41cb-83c8-4a6f33f4beab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab', 'volume_size': 1} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Flow 'volume_create_manager' (4326053b-250a-45cb-a306-889098c6b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b9fa03-040a-495d-b4c4-d928274ba16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de 1073741824" returned: 0 in 1.099s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b9fa03-040a-495d-b4c4-d928274ba16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507709ee-c19b-491c-bf79-b738abe62b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f86615045a64da5aa53fec8ee9ac457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:58Z,use_quota=True,user_id='737922a547494e1c8688e78558266702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967187fc-747a-4c9a-8f51-9b62e5e4ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967187fc-747a-4c9a-8f51-9b62e5e4ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bf825c-43da-40f7-a8cd-6af58289f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bf825c-43da-40f7-a8cd-6af58289f969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507709ee-c19b-491c-bf79-b738abe62b4d', 'volume_name': 'volume-507709ee-c19b-491c-bf79-b738abe62b4d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcf2f13-cc9f-4b8b-86e3-58b25845a308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcf2f13-cc9f-4b8b-86e3-58b25845a308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57105bc-120b-4a8d-afc6-60120df92e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Volume 507709ee-c19b-491c-bf79-b738abe62b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507709ee-c19b-491c-bf79-b738abe62b4d', 'volume_size': 1} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:58 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de Jul 19 13:14:58 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (b7f39d35-ee54-43d7-9746-e2bed0b43453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a21a5a8-8964-4894-9ddf-b80675429072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a21a5a8-8964-4894-9ddf-b80675429072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129831413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba43c81-627c-4dc0-af9f-ba792042866f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:58Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5255b999-a55f-473d-9b1e-9b4b9ba54520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5255b999-a55f-473d-9b1e-9b4b9ba54520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea1c920-0951-49c4-949c-bd00a99398cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea1c920-0951-49c4-949c-bd00a99398cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba43c81-627c-4dc0-af9f-ba792042866f', 'volume_name': 'volume-2ba43c81-627c-4dc0-af9f-ba792042866f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a03f620-579e-4e58-a8d3-fb1671574a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a03f620-579e-4e58-a8d3-fb1671574a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6a267f-14c9-4c94-8c1f-083df225f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Volume 2ba43c81-627c-4dc0-af9f-ba792042866f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba43c81-627c-4dc0-af9f-ba792042866f', 'volume_size': 1} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:58 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de" returned: 0 in 0.575s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878584522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0dc146-06a5-41cb-83c8-4a6f33f4beab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:57Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Creating volume ac0dc146-06a5-41cb-83c8-4a6f33f4beab {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:58 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fc0d76-707a-4048-a333-667a77d5af6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab 1073741824 Jul 19 13:14:58 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e84363-dad3-4fe0-801d-458977f97584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (efeab3e4-b1dc-4d72-85ea-5caa99974e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a81143-6a19-48e8-9efc-3f9baed2d1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Volume volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de (80e4bea6-9dd8-4cf5-bb10-375dfc97a9de): created successfully Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e84363-dad3-4fe0-801d-458977f97584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (d977e6db-07ed-4f1f-9272-bab4e6f86cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a81143-6a19-48e8-9efc-3f9baed2d1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1717999929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a18000-c18b-407f-8e57-f788a93faa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:59Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51546dd2-1091-452d-8f4e-22c0739bf9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51546dd2-1091-452d-8f4e-22c0739bf9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c17e8-12a6-4d83-92fb-084fa6dce619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c17e8-12a6-4d83-92fb-084fa6dce619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a18000-c18b-407f-8e57-f788a93faa3b', 'volume_name': 'volume-54a18000-c18b-407f-8e57-f788a93faa3b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90056c18-4584-44a2-9e18-b15032aeb55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90056c18-4584-44a2-9e18-b15032aeb55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b0449a-96bc-4446-b59c-f47c6b29bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Volume 54a18000-c18b-407f-8e57-f788a93faa3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a18000-c18b-407f-8e57-f788a93faa3b', 'volume_size': 1} Jul 19 13:14:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7a06d141-6eef-4458-a5fe-52d2709103ac tempest-CreateVolumesFromImageTest-1691181063 None] Created volume successfully. Jul 19 13:14:59 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab 1073741824" returned: 0 in 0.600s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:59 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab Jul 19 13:14:59 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:59 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab" returned: 0 in 0.283s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507709ee-c19b-491c-bf79-b738abe62b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f86615045a64da5aa53fec8ee9ac457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:58Z,use_quota=True,user_id='737922a547494e1c8688e78558266702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Creating volume 507709ee-c19b-491c-bf79-b738abe62b4d {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:14:59 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:14:59 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d 1073741824 Jul 19 13:14:59 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6cefd0-5957-42ef-9b0d-90efc97c03bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b634db-2705-4cb1-9f81-f818849cb9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:14:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Volume volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab (ac0dc146-06a5-41cb-83c8-4a6f33f4beab): created successfully Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b634db-2705-4cb1-9f81-f818849cb9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:14:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (9ee01ac4-d73e-4a8e-8dbe-f7fbc7a617f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:14:59 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-076590f4-776f-4f29-8827-d116dff8651a tempest-CreateVolumesFromImageTest-1691181063 None] Created volume successfully. Jul 19 13:15:00 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d 1073741824" returned: 0 in 0.566s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:00 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d Jul 19 13:15:00 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:00 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d" returned: 0 in 0.359s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129831413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba43c81-627c-4dc0-af9f-ba792042866f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:58Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Creating volume 2ba43c81-627c-4dc0-af9f-ba792042866f {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:00 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:00 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f 1073741824 Jul 19 13:15:00 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57105bc-120b-4a8d-afc6-60120df92e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507709ee-c19b-491c-bf79-b738abe62b4d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9df2ccd-53f8-4bd0-b894-b3f04b4583fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:00 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Volume volume-507709ee-c19b-491c-bf79-b738abe62b4d (507709ee-c19b-491c-bf79-b738abe62b4d): created successfully Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9df2ccd-53f8-4bd0-b894-b3f04b4583fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Flow 'volume_create_manager' (4326053b-250a-45cb-a306-889098c6b46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9479c35f-992e-4837-9042-49a2b0f2f52c tempest-VolumesListAdminTestJSON-612925342 None] Created volume successfully. Jul 19 13:15:01 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f 1073741824" returned: 0 in 0.591s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:01 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f Jul 19 13:15:01 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:01 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.631s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1717999929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a18000-c18b-407f-8e57-f788a93faa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e418273f44424c8bab7d1178da7edf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:14:59Z,use_quota=True,user_id='21c049febf7747aaa304b624dc640f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Creating volume 54a18000-c18b-407f-8e57-f788a93faa3b {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:01 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6a267f-14c9-4c94-8c1f-083df225f79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba43c81-627c-4dc0-af9f-ba792042866f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:01 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b 1073741824 Jul 19 13:15:01 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75de1711-7075-4ded-8515-53c5b91dc0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:01 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Volume volume-2ba43c81-627c-4dc0-af9f-ba792042866f (2ba43c81-627c-4dc0-af9f-ba792042866f): created successfully Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75de1711-7075-4ded-8515-53c5b91dc0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (b7f39d35-ee54-43d7-9746-e2bed0b43453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:01 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9df56d23-3b69-4a77-a4a4-5a1ace747568 tempest-CreateVolumesFromImageTest-1691181063 None] Created volume successfully. Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Acquiring lock "cinder-507709ee-c19b-491c-bf79-b738abe62b4d-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Lock "cinder-507709ee-c19b-491c-bf79-b738abe62b4d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Acquiring lock "cinder-quobyte-507709ee-c19b-491c-bf79-b738abe62b4d" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Lock "cinder-quobyte-507709ee-c19b-491c-bf79-b738abe62b4d" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce933352-630f-40f8-a218-b587cde4d37a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "cinder-d9901e8a-32ef-4ba5-a1f9-517a359f3935-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-d9901e8a-32ef-4ba5-a1f9-517a359f3935-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:02 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d Jul 19 13:15:02 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "cinder-quobyte-d9901e8a-32ef-4ba5-a1f9-517a359f3935" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:02 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b 1073741824" returned: 0 in 0.634s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-quobyte-d9901e8a-32ef-4ba5-a1f9-517a359f3935" acquired by "delete_volume" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2661bd03-d8fe-4d25-93bd-006534cd50d4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:02 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b Jul 19 13:15:02 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:02 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 Jul 19 13:15:02 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:02 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d" returned: 0 in 0.429s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:02 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d Jul 19 13:15:02 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:02 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b" returned: 0 in 0.312s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b0449a-96bc-4446-b59c-f47c6b29bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a18000-c18b-407f-8e57-f788a93faa3b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6dbc90-6503-452c-b51c-f7837fd18e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:02 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Volume volume-54a18000-c18b-407f-8e57-f788a93faa3b (54a18000-c18b-407f-8e57-f788a93faa3b): created successfully Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6dbc90-6503-452c-b51c-f7837fd18e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Flow 'volume_create_manager' (efeab3e4-b1dc-4d72-85ea-5caa99974e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:02 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1a1a2283-eb63-471e-8854-10bbdea5b766 tempest-CreateVolumesFromImageTest-1691181063 None] Created volume successfully. Jul 19 13:15:02 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935" returned: 0 in 0.421s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:02 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935 Jul 19 13:15:02 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:02 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-507709ee-c19b-491c-bf79-b738abe62b4d" returned: 0 in 0.295s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Lock "cinder-quobyte-507709ee-c19b-491c-bf79-b738abe62b4d" released by "delete_volume" :: held 0.787s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Created reservations ['dbe3515d-b624-4f61-b4eb-f0eb27852437', '4bfe7001-949f-45ff-9d0e-3d5e27aec8ba', '3f5e3911-7e56-4895-ba22-35132c792591', '82dbb334-aa4e-4e3e-a6ef-f920770a320a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:02 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d9901e8a-32ef-4ba5-a1f9-517a359f3935" returned: 0 in 0.317s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:02 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:02 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-quobyte-d9901e8a-32ef-4ba5-a1f9-517a359f3935" released by "delete_volume" :: held 0.800s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-54a18000-c18b-407f-8e57-f788a93faa3b-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-54a18000-c18b-407f-8e57-f788a93faa3b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Created reservations ['fcf03a7d-4b87-41a1-ae4f-6f6f7a9d943d', '1c6795d4-c811-4fdb-bb79-e24ebe1e02f9', '09a3e587-3a43-4add-a62b-5f9498c5508c', 'a15b558c-324d-4b64-9d1d-62d5efc62edc'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-quobyte-54a18000-c18b-407f-8e57-f788a93faa3b" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-54a18000-c18b-407f-8e57-f788a93faa3b" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef4efba-21d9-42d3-b6d3-1da14c5a411a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:03 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:03 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b Jul 19 13:15:03 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.452s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Deleted volume successfully. Jul 19 13:15:03 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:03 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b90aeeb3-72bc-4f86-9f7d-8a3b6bf5f49b tempest-VolumesListAdminTestJSON-612925342 None] Lock "cinder-507709ee-c19b-491c-bf79-b738abe62b4d-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "cinder-ce8b22f0-86ff-49de-836e-ead7d97c27e8-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-ce8b22f0-86ff-49de-836e-ead7d97c27e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "cinder-quobyte-ce8b22f0-86ff-49de-836e-ead7d97c27e8" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-quobyte-ce8b22f0-86ff-49de-836e-ead7d97c27e8" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f8481a-9e09-4a46-a755-72f6b0d6c9c6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:03 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b" returned: 0 in 0.504s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:03 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:03 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.396s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:03 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Deleted volume successfully. Jul 19 13:15:03 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b Jul 19 13:15:03 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-84c3ebbf-30da-452b-a5c8-e49763b718f5 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-d9901e8a-32ef-4ba5-a1f9-517a359f3935-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:03 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-54a18000-c18b-407f-8e57-f788a93faa3b" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-54a18000-c18b-407f-8e57-f788a93faa3b" released by "delete_volume" :: held 0.840s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:04 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8" returned: 0 in 0.417s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:04 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8 Jul 19 13:15:04 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Created reservations ['3d910cca-f0fb-47a5-b2c9-7ffaabf606c0', '2dbc968a-307a-412a-9937-9e8fde4802c2', 'f17af01b-8208-4dd6-99e6-01644bf5553a', '2bb8373a-7eba-4715-9ebe-6fdf29ec86df'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:04 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:04 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-2ba43c81-627c-4dc0-af9f-ba792042866f-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-2ba43c81-627c-4dc0-af9f-ba792042866f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-quobyte-2ba43c81-627c-4dc0-af9f-ba792042866f" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:04 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ce8b22f0-86ff-49de-836e-ead7d97c27e8" returned: 0 in 0.340s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-2ba43c81-627c-4dc0-af9f-ba792042866f" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-quobyte-ce8b22f0-86ff-49de-836e-ead7d97c27e8" released by "delete_volume" :: held 0.811s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe49526-d11d-4c19-8c00-6c9a887c15cf]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Created reservations ['c587bc24-887f-4cf8-9cd6-2d47f4689a1b', 'a1d3a50b-0d65-4bb9-9d37-5b8ff2ce6498', 'abe1ca38-e913-4315-ab66-cc688bd98005', 'a878395e-720c-44ac-a4d6-3488af35e1d9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:04 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.328s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:04 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Deleted volume successfully. Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a97db694-6426-4351-bf35-8131d9914f70 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-54a18000-c18b-407f-8e57-f788a93faa3b-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:04 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f Jul 19 13:15:04 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:04 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:04 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "cinder-19ae158c-753f-4f54-9b2a-100ae1894795-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-19ae158c-753f-4f54-9b2a-100ae1894795-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "cinder-quobyte-19ae158c-753f-4f54-9b2a-100ae1894795" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-quobyte-19ae158c-753f-4f54-9b2a-100ae1894795" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[787f8afa-036a-463f-8ec1-7bc00b751a6e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:04 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.330s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:04 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f" returned: 0 in 0.499s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:04 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Deleted volume successfully. Jul 19 13:15:04 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f Jul 19 13:15:04 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1dd74103-a521-4336-84c1-33d673748e70 tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-ce8b22f0-86ff-49de-836e-ead7d97c27e8-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:05 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 Jul 19 13:15:05 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:05 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-2ba43c81-627c-4dc0-af9f-ba792042866f" returned: 0 in 0.289s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-2ba43c81-627c-4dc0-af9f-ba792042866f" released by "delete_volume" :: held 0.830s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=107,cinder:UPDATE=139,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Created reservations ['f0c91b10-0eba-4e9f-9641-9b187885f021', '44e20fce-5f57-4ffb-a6a9-58989aa24a85', '490c4dee-ed86-4e7b-b101-ad7898c5d781', 'd1d0a2a8-9430-4f4c-abdf-ed18059758f4'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:05 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795" returned: 0 in 0.429s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:05 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795 Jul 19 13:15:05 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:05 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:05 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-ac0dc146-06a5-41cb-83c8-4a6f33f4beab-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-ac0dc146-06a5-41cb-83c8-4a6f33f4beab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:05 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19ae158c-753f-4f54-9b2a-100ae1894795" returned: 0 in 0.290s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-quobyte-ac0dc146-06a5-41cb-83c8-4a6f33f4beab" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-quobyte-19ae158c-753f-4f54-9b2a-100ae1894795" released by "delete_volume" :: held 0.780s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-ac0dc146-06a5-41cb-83c8-4a6f33f4beab" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b455cb-0073-4053-aed8-4d92faa44591]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:05 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.328s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:05 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Deleted volume successfully. Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Created reservations ['6e026cfa-404c-4a10-ac08-79190a9316fd', 'dba4a7fe-6684-463c-ae92-b08f394d740b', '39dc917c-773f-4549-b0bf-1cc087fdfb1c', 'f086eee1-56df-4574-81ff-36d4d04bee43'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-22b5a259-7d36-4091-9a5b-508dba96ddae tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-2ba43c81-627c-4dc0-af9f-ba792042866f-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:05 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab Jul 19 13:15:05 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:05 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:05 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:06 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.281s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Deleted volume successfully. Jul 19 13:15:06 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a7d95118-6fe8-488b-a494-c2db42e6abba tempest-VolumesListAdminTestJSON-1365189898 None] Lock "cinder-19ae158c-753f-4f54-9b2a-100ae1894795-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:06 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab Jul 19 13:15:06 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:06 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ac0dc146-06a5-41cb-83c8-4a6f33f4beab" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-ac0dc146-06a5-41cb-83c8-4a6f33f4beab" released by "delete_volume" :: held 0.806s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Created reservations ['8ffdaa67-2bae-42f0-851d-cf18a2ad0f55', '4854d7a1-0b97-4db3-9142-c18b3a36b65f', '5c7b9613-bb0d-4a1c-9b6b-0ec3a324db8d', 'bf1db42d-b992-4068-81f3-ee913553f78d'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:06 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:06 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-quobyte-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69caf83-37ba-4e9a-8e9d-98d11565edf4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:06 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.312s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Deleted volume successfully. Jul 19 13:15:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-85d70c5f-64c7-4074-9c1c-63102ae2c6eb tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-ac0dc146-06a5-41cb-83c8-4a6f33f4beab-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:07 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de Jul 19 13:15:07 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:07 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de" returned: 0 in 0.495s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:07 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de Jul 19 13:15:07 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Acquiring lock "cinder-cdec9fc3-9925-492f-9e24-0b44d0dfa865-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Lock "cinder-cdec9fc3-9925-492f-9e24-0b44d0dfa865-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Acquiring lock "cinder-quobyte-cdec9fc3-9925-492f-9e24-0b44d0dfa865" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:07 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Lock "cinder-quobyte-cdec9fc3-9925-492f-9e24-0b44d0dfa865" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de" returned: 0 in 0.408s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de" released by "delete_volume" :: held 0.946s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=135,cinder:SELECT=114,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d13758-e0f1-435f-a32c-e9df82d50a9f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:07 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Created reservations ['47b9462d-70ac-4c34-97fd-c6eca3e67264', '5c01e192-a719-433b-a7b3-5e51aa98b15f', '1e6089ed-39d3-41bb-bdad-9ed234c1e720', '033019d8-3e94-4482-ae6f-ea4249829cb7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:08 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 Jul 19 13:15:08 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:08 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:08 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:08 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865" returned: 0 in 0.509s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:08 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865 Jul 19 13:15:08 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:08 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.407s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Deleted volume successfully. Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6cedc275-c915-405c-bc81-00471fd050c2 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-80e4bea6-9dd8-4cf5-bb10-375dfc97a9de-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:08 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cdec9fc3-9925-492f-9e24-0b44d0dfa865" returned: 0 in 0.296s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Lock "cinder-quobyte-cdec9fc3-9925-492f-9e24-0b44d0dfa865" released by "delete_volume" :: held 0.876s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Created reservations ['b105345f-d693-4fd4-a682-27c6292eb082', 'e9ae36c4-0d71-423c-9d57-4ddefc86a427', 'dff45b80-32eb-41ac-936b-fe1c095bbbeb', '261c63b9-95ad-4999-ad61-bd3078dfc9f0'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:08 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:08 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:09 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:09 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Deleted volume successfully. Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc3f6883-837f-4805-80f6-50447c3bc661 tempest-VolumesNegativeTest-525089979 None] Lock "cinder-cdec9fc3-9925-492f-9e24-0b44d0dfa865-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "cinder-quobyte-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb70b2-dc20-410a-be85-5b9b566448b3]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:09 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae Jul 19 13:15:09 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:09 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae" returned: 0 in 0.499s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:09 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae Jul 19 13:15:09 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:10 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-quobyte-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae" released by "delete_volume" :: held 0.880s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Created reservations ['c1560e53-d0b6-4d07-ab7c-0da1514ee188', '3982eca7-8702-4570-8385-bebe95935d35', '0023d03a-2b1d-4e39-96ec-9a832939fcbe', '44c6a3fc-3f47-462b-9121-14edb749e0ce'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:10 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:10 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:10 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.347s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:10 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Deleted volume successfully. Jul 19 13:15:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2548e74e-633e-4a2b-bd7a-b7a336bf7229 tempest-CreateVolumesFromImageTest-1691181063 None] Lock "cinder-4ad7fd44-d8e9-41f5-b961-ab7674c5d5ae-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Flow 'volume_create_manager' (2612e01c-2a59-4405-a4dc-70df2776c465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9f720e-578b-44a0-b569-86ff2baf9157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9f720e-578b-44a0-b569-86ff2baf9157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-920859194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f1d42d-4ef6-47ca-8c80-661959a5406b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7df331912b467fbc371309eee6be04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:13Z,use_quota=True,user_id='870ffa4e516a4f3a9144539a53c5e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94df6a0-c084-4f83-b39e-e6ae55adf7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94df6a0-c084-4f83-b39e-e6ae55adf7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f56df9-3208-4b72-912f-6e58a95c327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f56df9-3208-4b72-912f-6e58a95c327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f1d42d-4ef6-47ca-8c80-661959a5406b', 'volume_name': 'volume-10f1d42d-4ef6-47ca-8c80-661959a5406b', 'volume_size': 2}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3543804c-2b77-4f21-ab8a-85ffb88cd132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3543804c-2b77-4f21-ab8a-85ffb88cd132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9be0c49-755e-4e8a-808b-4d06dc9f4c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:13 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Volume 10f1d42d-4ef6-47ca-8c80-661959a5406b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f1d42d-4ef6-47ca-8c80-661959a5406b', 'volume_size': 2} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-920859194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f1d42d-4ef6-47ca-8c80-661959a5406b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7df331912b467fbc371309eee6be04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:13Z,use_quota=True,user_id='870ffa4e516a4f3a9144539a53c5e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Creating volume 10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:13 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b 2147483648 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:13 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b 2147483648 Jul 19 13:15:13 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:14 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b 2147483648" returned: 0 in 0.681s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:14 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b Jul 19 13:15:14 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:14 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b" returned: 0 in 0.305s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9be0c49-755e-4e8a-808b-4d06dc9f4c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f1d42d-4ef6-47ca-8c80-661959a5406b', 'volume_size': 2}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092e077-5c74-4acc-9e4e-5a33b9f9e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Volume volume-10f1d42d-4ef6-47ca-8c80-661959a5406b (10f1d42d-4ef6-47ca-8c80-661959a5406b): created successfully Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092e077-5c74-4acc-9e4e-5a33b9f9e37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Flow 'volume_create_manager' (2612e01c-2a59-4405-a4dc-70df2776c465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-767d56b0-2012-43bd-8e24-9085679f52f5 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Created volume successfully. Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Flow 'volume_create_manager' (7681e315-b940-4514-8ed2-138207d6f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca1625-ab26-47c2-8ece-db077490c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca1625-ab26-47c2-8ece-db077490c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b546e0d4-9da7-4f75-bd9d-c67eac30361b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a354685cff1b4c5685810d165bc42bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:15Z,use_quota=True,user_id='7a3bb75a53cd407bbbebe3276f26d6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf317b66-eaa9-4d99-a1cc-8fbff1a1bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf317b66-eaa9-4d99-a1cc-8fbff1a1bb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5819f-f414-47a2-a1e4-24cb8463a92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5819f-f414-47a2-a1e4-24cb8463a92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b546e0d4-9da7-4f75-bd9d-c67eac30361b', 'volume_name': 'volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a615bcc5-2156-4367-840c-b107aebf1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a615bcc5-2156-4367-840c-b107aebf1fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e40270d-4ad4-4f42-afd2-858a67cac3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Volume b546e0d4-9da7-4f75-bd9d-c67eac30361b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b', 'volume_size': 1} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b546e0d4-9da7-4f75-bd9d-c67eac30361b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a354685cff1b4c5685810d165bc42bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:15Z,use_quota=True,user_id='7a3bb75a53cd407bbbebe3276f26d6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Creating volume b546e0d4-9da7-4f75-bd9d-c67eac30361b {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:15 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:15 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b 1073741824 Jul 19 13:15:15 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-4a48910c-7490-4cea-a5f9-9c891b30e13d req-0ca2aead-4f23-46c6-9a6a-2af71c25a078 tempest-TestShelveInstance-2000878765 None] Terminate volume connection completed successfully. Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-4a48910c-7490-4cea-a5f9-9c891b30e13d req-0ca2aead-4f23-46c6-9a6a-2af71c25a078 tempest-TestShelveInstance-2000878765 None] Deleting attachment 17963d91-2490-4f6b-91a3-eb637e93f2c8. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Flow 'volume_create_manager' (4f5dd829-c228-4763-b407-b3b69c930283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a842135-45ca-40b4-b06c-5da1dfeb8ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a842135-45ca-40b4-b06c-5da1dfeb8ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-374758437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dbf251-d669-405d-a56e-3ab0951a9ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db71357c29014383800b864c0bb5c117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:15Z,use_quota=True,user_id='4e412a6a6f2a400b95efb1527b183b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0176ad-2b11-41b7-b079-86b4aa25c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0176ad-2b11-41b7-b079-86b4aa25c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c87d20-b10a-4d57-8378-d499b8c6316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c87d20-b10a-4d57-8378-d499b8c6316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85dbf251-d669-405d-a56e-3ab0951a9ee9', 'volume_name': 'volume-85dbf251-d669-405d-a56e-3ab0951a9ee9', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a884f0ba-e232-41ed-b9bb-0524c0296275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a884f0ba-e232-41ed-b9bb-0524c0296275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e5e8de-7734-4b86-b47d-b18013e07cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:15 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Volume 85dbf251-d669-405d-a56e-3ab0951a9ee9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85dbf251-d669-405d-a56e-3ab0951a9ee9', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Trying to clone 85dbf251-d669-405d-a56e-3ab0951a9ee9 from image 97bba3f0-2950-4456-be46-6a90be277718 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:15:15 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b 1073741824" returned: 0 in 0.671s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:15 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b Jul 19 13:15:15 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:15:16 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Image download 20.69 MB at 20.69 MB/s Jul 19 13:15:16 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b" returned: 0 in 0.294s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.496s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e40270d-4ad4-4f42-afd2-858a67cac3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d1d8f-9bdd-4659-9183-37974e9d6b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Creating offline snapshot 850ee4cd-7ec0-4405-afc4-8465b7458591 of volume 10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e699d869-4dd0-4743-be03-06c90a4c8d05]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:16 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Volume volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b (b546e0d4-9da7-4f75-bd9d-c67eac30361b): created successfully Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d1d8f-9bdd-4659-9183-37974e9d6b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Flow 'volume_create_manager' (7681e315-b940-4514-8ed2-138207d6f755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac4fcc6-0845-48a9-9b98-64a0bcc05fbf]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1926d036-b651-4c51-9b3c-ef7e1f210a3d tempest-CinderUnicodeTest-788587233 None] Created volume successfully. Jul 19 13:15:16 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b Jul 19 13:15:16 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:16 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD Jul 19 13:15:16 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:16 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 is fetched for user 4e412a6a6f2a400b95efb1527b183b24. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:15:16 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b" returned: 0 in 0.385s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 2G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:16 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 2G Jul 19 13:15:16 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478d6b1-400c-49d5-aae6-bd4206cfd9f9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:16 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD Jul 19 13:15:16 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:17 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 2G" returned: 0 in 0.422s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10f1d42d-4ef6-47ca-8c80-661959a5406b -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:17 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:17 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10f1d42d-4ef6-47ca-8c80-661959a5406b -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 Jul 19 13:15:17 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:17 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10f1d42d-4ef6-47ca-8c80-661959a5406b -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:17 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 is being set with open permissions: ugo+rw Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:17 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 Jul 19 13:15:17 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:17 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591" returned: 0 in 0.316s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Flow 'volume_create_manager' (906ae6e8-9179-48da-b73b-9baf671f196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3fbe40-801d-4b89-8928-d2cc331463da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3fbe40-801d-4b89-8928-d2cc331463da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1908667435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46c3dc7-6b45-4dd0-a984-94ce78392bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a354685cff1b4c5685810d165bc42bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:18Z,use_quota=True,user_id='7a3bb75a53cd407bbbebe3276f26d6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:17 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.info Jul 19 13:15:17 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2730d4-6947-44d1-9576-8d936fcd0cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2730d4-6947-44d1-9576-8d936fcd0cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccf793a-b645-4e5b-880a-419376c4cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccf793a-b645-4e5b-880a-419376c4cf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46c3dc7-6b45-4dd0-a984-94ce78392bf2', 'volume_name': 'volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f23e5a2-1560-44f8-906a-8edc18c88315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f23e5a2-1560-44f8-906a-8edc18c88315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07d6a9b-9c3c-431d-9662-3ad71802544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:17 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Volume a46c3dc7-6b45-4dd0-a984-94ce78392bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2', 'volume_size': 1} Jul 19 13:15:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:18 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.info" returned: 0 in 0.278s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:18 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.info is being set with open permissions: ugo+rw Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:18 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.info Jul 19 13:15:18 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:18 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.info" returned: 0 in 0.285s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-374758437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dbf251-d669-405d-a56e-3ab0951a9ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db71357c29014383800b864c0bb5c117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:15Z,use_quota=True,user_id='4e412a6a6f2a400b95efb1527b183b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Creating volume 85dbf251-d669-405d-a56e-3ab0951a9ee9 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:18 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:18 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 1073741824 Jul 19 13:15:18 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-dc4bfd54-b7d7-4f7a-ae8b-ea612be2f836 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Create snapshot completed successfully Jul 19 13:15:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-629614c5-4d14-4775-89df-66a491426fef req-0c4da3b8-ac91-495f-9755-84b0a613795b tempest-TestShelveInstance-2000878765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "cinder-850ee4cd-7ec0-4405-afc4-8465b7458591-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-850ee4cd-7ec0-4405-afc4-8465b7458591-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "cinder-quobyte-10f1d42d-4ef6-47ca-8c80-661959a5406b" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-quobyte-10f1d42d-4ef6-47ca-8c80-661959a5406b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "cinder-quobyte-850ee4cd-7ec0-4405-afc4-8465b7458591" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-quobyte-850ee4cd-7ec0-4405-afc4-8465b7458591" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:19 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Deleting offline snapshot 850ee4cd-7ec0-4405-afc4-8465b7458591 of volume 10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] snapshot_file for this snap is: volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 1073741824" returned: 0 in 0.615s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44c43b0-9d0d-447c-bfd7-28bfe70753ea]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:19 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 Jul 19 13:15:19 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:19 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 Jul 19 13:15:19 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:19 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1908667435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46c3dc7-6b45-4dd0-a984-94ce78392bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a354685cff1b4c5685810d165bc42bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:18Z,use_quota=True,user_id='7a3bb75a53cd407bbbebe3276f26d6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Creating volume a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:19 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:19 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 1073741824 Jul 19 13:15:19 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Attempting download of 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume 85dbf251-d669-405d-a56e-3ab0951a9ee9. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:15:19 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591" returned: 0 in 0.376s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10f1d42d-4ef6-47ca-8c80-661959a5406b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[52248274-b47e-41ec-bd51-2d0466b2ddcb]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_x0l2pbkp {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9068700-991a-4fd5-8404-967035aa55a8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:19 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_x0l2pbkp Jul 19 13:15:19 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:19 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b Jul 19 13:15:19 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:19 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:19 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_x0l2pbkp" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 1073741824" returned: 0 in 0.502s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_x0l2pbkp {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:20 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b" returned: 0 in 0.486s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:20 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 Jul 19 13:15:20 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:20 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 Jul 19 13:15:20 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:20 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_x0l2pbkp Jul 19 13:15:20 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:20 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" returned: 0 in 0.366s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:20 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-629614c5-4d14-4775-89df-66a491426fef req-0c4da3b8-ac91-495f-9755-84b0a613795b tempest-TestShelveInstance-2000878765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.686s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_x0l2pbkp" returned: 1 in 0.462s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_x0l2pbkp' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[085cc90d-7949-463e-a097-eed6f4e2c8a7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-629614c5-4d14-4775-89df-66a491426fef req-0c4da3b8-ac91-495f-9755-84b0a613795b tempest-TestShelveInstance-2000878765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07d6a9b-9c3c-431d-9662-3ad71802544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708dcfd3-26e5-4d38-9fdf-4f9e1b7883bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:20 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Volume volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 (a46c3dc7-6b45-4dd0-a984-94ce78392bf2): created successfully Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708dcfd3-26e5-4d38-9fdf-4f9e1b7883bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Flow 'volume_create_manager' (906ae6e8-9179-48da-b73b-9baf671f196c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8fccf7e3-9449-4893-a6d3-51602120dd6c tempest-CinderUnicodeTest-788587233 None] Created volume successfully. Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-629614c5-4d14-4775-89df-66a491426fef req-0c4da3b8-ac91-495f-9755-84b0a613795b tempest-TestShelveInstance-2000878765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-c559c66f-0baa-4520-956c-6b95620cf5d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06d8da18-24a7-4f2c-b8bd-2953aa51c53f', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:15:20 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591" returned: 0 in 0.481s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:20 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD Jul 19 13:15:20 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:20 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591 Jul 19 13:15:20 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-629614c5-4d14-4775-89df-66a491426fef req-0c4da3b8-ac91-495f-9755-84b0a613795b tempest-TestShelveInstance-2000878765 None] attachment_update completed successfully. Jul 19 13:15:20 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] 97bba3f0-2950-4456-be46-6a90be277718 was qcow2, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:20 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b.850ee4cd-7ec0-4405-afc4-8465b7458591" returned: 0 in 0.283s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:20 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 Jul 19 13:15:20 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-quobyte-850ee4cd-7ec0-4405-afc4-8465b7458591" released by "_delete_snapshot" :: held 1.771s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-quobyte-10f1d42d-4ef6-47ca-8c80-661959a5406b" released by "delete_snapshot" :: held 1.803s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:20 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Created reservations ['11e4f900-0147-4a4e-acd6-82a7d5c3b0b8', '6200d6fb-437b-4b96-a667-095a5dbc4b3e', 'f6a6c83f-ab82-4b89-8573-97ea7ca2875f', 'affa2f7f-7c5d-4dbb-ace2-ebc75fb0e4b5'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Delete snapshot completed successfully. Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e22c9ca1-a420-4d50-8d06-8800bdf4bc56 tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-850ee4cd-7ec0-4405-afc4-8465b7458591-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "cinder-10f1d42d-4ef6-47ca-8c80-661959a5406b-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-10f1d42d-4ef6-47ca-8c80-661959a5406b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "cinder-quobyte-10f1d42d-4ef6-47ca-8c80-661959a5406b" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-quobyte-10f1d42d-4ef6-47ca-8c80-661959a5406b" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Creating offline snapshot 55021a57-4957-49a7-8e0e-55c63c33051a of volume a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04501455-feea-4c95-a41c-5af18ebbce29]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151f4d7-e4e2-4997-8a46-82d449eba3ef]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:21 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 Jul 19 13:15:21 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:21 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b Jul 19 13:15:21 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:21 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" returned: 0 in 0.471s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:22 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a 1G Jul 19 13:15:22 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:22 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b" returned: 0 in 0.535s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:22 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b Jul 19 13:15:22 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:22 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-10f1d42d-4ef6-47ca-8c80-661959a5406b" returned: 0 in 0.428s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-quobyte-10f1d42d-4ef6-47ca-8c80-661959a5406b" released by "delete_volume" :: held 1.044s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Created reservations ['4d0b6d29-ef20-4ccb-b927-dd32998057ec', 'cb93ca97-8791-46a4-b5b9-8e8fa09a0311', '10ef9dec-93ef-4740-9854-5d008ef1afd4', 'c6e3b494-56c7-40ea-907a-f87f765d4ff0'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:22 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a 1G" returned: 0 in 0.685s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:22 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a Jul 19 13:15:22 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:22 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:22 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:23 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a" returned: 0 in 0.440s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:23 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a is being set with open permissions: ugo+rw Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:23 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Deleted volume successfully. Jul 19 13:15:23 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a Jul 19 13:15:23 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0c0d5a39-924f-4fba-9912-f66adb58644e tempest-VolumesSnapshotNegativeTestJSON-1861698958 None] Lock "cinder-10f1d42d-4ef6-47ca-8c80-661959a5406b-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:23 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9" returned: 0 in 2.405s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_hx_ltjb2devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:15:23 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Converted 112.00 MB image at 46.55 MB/s Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:23 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 1G Jul 19 13:15:23 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:23 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a" returned: 0 in 0.330s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:23 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.info Jul 19 13:15:23 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:23 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 1G" returned: 0 in 0.426s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Downloaded image 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume 85dbf251-d669-405d-a56e-3ab0951a9ee9 successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 for user 4e412a6a6f2a400b95efb1527b183b24 is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Marking volume 85dbf251-d669-405d-a56e-3ab0951a9ee9 as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Copying metadata from image 97bba3f0-2950-4456-be46-6a90be277718 to 85dbf251-d669-405d-a56e-3ab0951a9ee9. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Creating volume glance metadata for volume 85dbf251-d669-405d-a56e-3ab0951a9ee9 backed by image 97bba3f0-2950-4456-be46-6a90be277718 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e5e8de-7734-4b86-b47d-b18013e07cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85dbf251-d669-405d-a56e-3ab0951a9ee9', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7074d5a1-8c58-4859-99c3-128349871b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:23 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Volume volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 (85dbf251-d669-405d-a56e-3ab0951a9ee9): created successfully Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7074d5a1-8c58-4859-99c3-128349871b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Flow 'volume_create_manager' (4f5dd829-c228-4763-b407-b3b69c930283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-02a508bf-be76-4f57-b2ab-1a0c583f4a1e tempest-VolumesImageMetadata-1323578324 None] Created volume successfully. Jul 19 13:15:24 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.info" returned: 0 in 0.707s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:24 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.info is being set with open permissions: ugo+rw Jul 19 13:15:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:24 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.info Jul 19 13:15:24 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:24 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.info" returned: 0 in 0.505s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.330s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c8ccf3f8-5854-4a9d-9e4b-27fb664d2eed tempest-CinderUnicodeTest-788587233 None] Create snapshot completed successfully Jul 19 13:15:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Acquiring lock "cinder-85dbf251-d669-405d-a56e-3ab0951a9ee9-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Lock "cinder-85dbf251-d669-405d-a56e-3ab0951a9ee9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Acquiring lock "cinder-quobyte-85dbf251-d669-405d-a56e-3ab0951a9ee9" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Lock "cinder-quobyte-85dbf251-d669-405d-a56e-3ab0951a9ee9" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c90d754-5511-4166-9165-9e5513caefdc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:25 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 Jul 19 13:15:25 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:25 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9" returned: 0 in 0.524s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Acquiring lock "cinder-55021a57-4957-49a7-8e0e-55c63c33051a-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:25 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9 Jul 19 13:15:25 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Lock "cinder-55021a57-4957-49a7-8e0e-55c63c33051a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Acquiring lock "cinder-quobyte-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Acquiring lock "cinder-quobyte-55021a57-4957-49a7-8e0e-55c63c33051a" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-55021a57-4957-49a7-8e0e-55c63c33051a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Deleting offline snapshot 55021a57-4957-49a7-8e0e-55c63c33051a of volume a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] snapshot_file for this snap is: volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39168ec-206e-4fa2-a849-e87846a3c876]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:26 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a Jul 19 13:15:26 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:26 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-85dbf251-d669-405d-a56e-3ab0951a9ee9" returned: 0 in 0.460s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Lock "cinder-quobyte-85dbf251-d669-405d-a56e-3ab0951a9ee9" released by "delete_volume" :: held 1.103s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Created reservations ['6b90beea-b693-44bb-a42b-1e321bd05090', 'ecb779d7-e342-46f5-a67c-de78031cce2c', '08a379a1-3c51-474a-9d87-2884a7b60eb2', 'ae38e2be-9f29-405f-90cf-17598ee38b03'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:26 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:26 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:26 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a" returned: 0 in 0.717s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b86bd5-f7e4-407a-81ee-6ccb738739a5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:26 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 Jul 19 13:15:26 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:26 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Deleted volume successfully. Jul 19 13:15:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-13201d9a-aa9b-4ff2-82ef-321ab1f9eb18 tempest-VolumesImageMetadata-1323578324 None] Lock "cinder-85dbf251-d669-405d-a56e-3ab0951a9ee9-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:27 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" returned: 0 in 0.517s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:27 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a Jul 19 13:15:27 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:27 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a" returned: 0 in 0.593s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:27 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a Jul 19 13:15:27 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:28 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2.55021a57-4957-49a7-8e0e-55c63c33051a" returned: 0 in 0.386s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-55021a57-4957-49a7-8e0e-55c63c33051a" released by "_delete_snapshot" :: held 2.388s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" released by "delete_snapshot" :: held 2.433s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:28 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Created reservations ['9a5f5dfb-3eca-411b-ac2e-33e9329f3f17', 'f207bda8-dde3-4eb1-ab56-1b97612b1e3e', '6a0f721d-16cf-4289-b013-30cf46d57858', '76a33ea4-c392-41db-960f-470b46c35a58'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:28 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Delete snapshot completed successfully. Jul 19 13:15:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ee6fe9e7-5571-439b-8e8b-5c0203e23b5c tempest-CinderUnicodeTest-788587233 None] Lock "cinder-55021a57-4957-49a7-8e0e-55c63c33051a-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Acquiring lock "cinder-a46c3dc7-6b45-4dd0-a984-94ce78392bf2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-a46c3dc7-6b45-4dd0-a984-94ce78392bf2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Acquiring lock "cinder-quobyte-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:29 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ace9e-48d4-4cbf-8cdf-b60dd926d774]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:29 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 Jul 19 13:15:29 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:29 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" returned: 0 in 0.618s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:29 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2 Jul 19 13:15:29 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:30 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" returned: 0 in 0.357s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-a46c3dc7-6b45-4dd0-a984-94ce78392bf2" released by "delete_volume" :: held 1.091s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Created reservations ['b2210f46-e99e-40c6-9bf7-d0bc747f0460', '402d7b7e-ae5f-4522-a970-3b78b5e11ce4', '0f663aae-2118-4ecd-a18d-1df15f0fd0f7', 'dcd969e5-9dfa-44f9-a092-c7b6955faa48'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:30 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:30 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:30 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.349s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Deleted volume successfully. Jul 19 13:15:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-14e3c03b-34b9-4fe6-8143-4d6d66479521 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-a46c3dc7-6b45-4dd0-a984-94ce78392bf2-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Acquiring lock "cinder-b546e0d4-9da7-4f75-bd9d-c67eac30361b-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-b546e0d4-9da7-4f75-bd9d-c67eac30361b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Acquiring lock "cinder-quobyte-b546e0d4-9da7-4f75-bd9d-c67eac30361b" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-b546e0d4-9da7-4f75-bd9d-c67eac30361b" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d988864-f011-497c-ba7d-6ce35ae7d80b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:31 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b Jul 19 13:15:31 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Flow 'volume_create_manager' (4a64f697-53b3-4af6-9b76-974a6035d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb19706-b865-434d-b6b1-cebd849d0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb19706-b865-434d-b6b1-cebd849d0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-420089095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bf6b33-42a4-4a84-a409-4041c62d71d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5d0292a32547cb9901b55c99598fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:32Z,use_quota=True,user_id='1d669186b1f34585a8a2f4fc229e284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c219de7-82ae-4f77-b6ec-e897574f9961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c219de7-82ae-4f77-b6ec-e897574f9961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7872bc-8bf7-43bd-a23b-5af3721fcb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7872bc-8bf7-43bd-a23b-5af3721fcb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5bf6b33-42a4-4a84-a409-4041c62d71d8', 'volume_name': 'volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5cde8-6e54-432a-8808-24bdb37f7911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5cde8-6e54-432a-8808-24bdb37f7911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6361d256-76c5-4ac8-9789-7fa01a1f00a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:31 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Volume e5bf6b33-42a4-4a84-a409-4041c62d71d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8', 'volume_size': 1} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-420089095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bf6b33-42a4-4a84-a409-4041c62d71d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5d0292a32547cb9901b55c99598fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:32Z,use_quota=True,user_id='1d669186b1f34585a8a2f4fc229e284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Creating volume e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:31 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:31 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 1073741824 Jul 19 13:15:31 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:32 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b" returned: 0 in 0.485s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:32 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b Jul 19 13:15:32 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:32 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 1073741824" returned: 0 in 0.511s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:32 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b546e0d4-9da7-4f75-bd9d-c67eac30361b" returned: 0 in 0.301s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-quobyte-b546e0d4-9da7-4f75-bd9d-c67eac30361b" released by "delete_volume" :: held 0.860s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:32 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 Jul 19 13:15:32 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Created reservations ['9d75d60e-c166-44b2-87ff-453d9e3a5a07', 'f81bd026-d233-4d31-91d1-57379adbd2c9', 'e6b71d99-5036-4d10-8ca3-0b67bc0a4525', '1cac3151-de05-4dcc-aee2-785d7250510e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:32 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:32 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:32 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8" returned: 0 in 0.441s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6361d256-76c5-4ac8-9789-7fa01a1f00a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c797edc1-1c7e-4319-938b-f295376edd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:32 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Volume volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 (e5bf6b33-42a4-4a84-a409-4041c62d71d8): created successfully Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c797edc1-1c7e-4319-938b-f295376edd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Flow 'volume_create_manager' (4a64f697-53b3-4af6-9b76-974a6035d47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-34891c97-4243-4f9c-8f8d-f53a8ae40e3e tempest-SnapshotMetadataTestJSON-727742669 None] Created volume successfully. Jul 19 13:15:33 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.453s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Deleted volume successfully. Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-23191d34-3ac0-47d2-bcab-84dfb06ac8e6 tempest-CinderUnicodeTest-788587233 None] Lock "cinder-b546e0d4-9da7-4f75-bd9d-c67eac30361b-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Flow 'volume_create_manager' (c6c1ab37-bf80-4982-ae86-d36ae34332ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e0f8da-b4e8-4b1d-be29-0fa65c182470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e0f8da-b4e8-4b1d-be29-0fa65c182470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d6b5fe-8782-47a1-b8a4-153a75a346a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9874fae061a64afea0195af91160ae65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:33Z,use_quota=True,user_id='0adb6e80bb194d078c147dde68957c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0be63dae-eb21-4ad6-a947-aa07167f4621),volume_type_id=0be63dae-eb21-4ad6-a947-aa07167f4621)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7da1578-8068-4296-ac49-600492cc5359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7da1578-8068-4296-ac49-600492cc5359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5156c969-cdf9-4481-8432-f0cbfc11700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5156c969-cdf9-4481-8432-f0cbfc11700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2d6b5fe-8782-47a1-b8a4-153a75a346a4', 'volume_name': 'volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4', 'volume_size': 1, 'image_id': '5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f0d5e508ccda131756f42c7419e4153', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9874fae061a64afea0195af91160ae65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39103bb50139fa7c445bcc0aeee17c0c3a3a25bb91ac9d3a626f999fa8a92e40f731aad5429a34d77cc8e29014636d244f49e609061db6227181c0d2dd70ebe6', 'id': '5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'created_at': datetime.datetime(2026, 7, 19, 11, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea394150-5fb4-4b9a-a3ce-1436fcc37968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea394150-5fb4-4b9a-a3ce-1436fcc37968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071c040b-4999-4386-920e-755b3b777fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:33 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Volume b2d6b5fe-8782-47a1-b8a4-153a75a346a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4', 'volume_size': 1, 'image_id': '5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f0d5e508ccda131756f42c7419e4153', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9874fae061a64afea0195af91160ae65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39103bb50139fa7c445bcc0aeee17c0c3a3a25bb91ac9d3a626f999fa8a92e40f731aad5429a34d77cc8e29014636d244f49e609061db6227181c0d2dd70ebe6', 'id': '5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'created_at': datetime.datetime(2026, 7, 19, 11, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Trying to clone b2d6b5fe-8782-47a1-b8a4-153a75a346a4 from image 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:15:33 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Image download 0.00 MB at 0.00 MB/s Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7923acee-fbe9-4d03-a83a-0194b389fb4e]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:34 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD Jul 19 13:15:34 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Creating offline snapshot a6f39b56-51e7-4f74-a8e4-15b189becc25 of volume e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c22290e-3fbc-42fb-83fe-49958604a356]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:34 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:34 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD" returned: 0 in 0.538s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:34 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:34 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD Jul 19 13:15:34 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:34 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:34 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Temporary image 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 is fetched for user 0adb6e80bb194d078c147dde68957c2f. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8" returned: 0 in 0.568s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:34 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 1G Jul 19 13:15:34 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8dd219-e151-48a4-b9a4-0d120e5a638d]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:35 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD Jul 19 13:15:35 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:35 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:35 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 1G" returned: 0 in 0.621s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:35 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD Jul 19 13:15:35 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:35 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 Jul 19 13:15:35 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:35 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:35 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25" returned: 0 in 0.400s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:35 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 is being set with open permissions: ugo+rw Jul 19 13:15:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:35 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 Jul 19 13:15:35 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:36 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:36 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.info Jul 19 13:15:36 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:36 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.info" returned: 0 in 0.352s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:36 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.info is being set with open permissions: ugo+rw Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:36 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.info Jul 19 13:15:36 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:36 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.info" returned: 0 in 0.283s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.594s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d6b5fe-8782-47a1-b8a4-153a75a346a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9874fae061a64afea0195af91160ae65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:33Z,use_quota=True,user_id='0adb6e80bb194d078c147dde68957c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0be63dae-eb21-4ad6-a947-aa07167f4621),volume_type_id=0be63dae-eb21-4ad6-a947-aa07167f4621)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Creating volume b2d6b5fe-8782-47a1-b8a4-153a75a346a4 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:36 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:36 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 1073741824 Jul 19 13:15:36 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-84c6d6cf-5a2e-4b45-ba47-470b50161995 tempest-SnapshotMetadataTestJSON-727742669 None] Create snapshot completed successfully Jul 19 13:15:37 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 1073741824" returned: 0 in 0.613s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:37 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 Jul 19 13:15:37 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:37 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4" returned: 0 in 0.292s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Attempting download of 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'metadata': {}}])) to volume b2d6b5fe-8782-47a1-b8a4-153a75a346a4. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d4fe51-d222-4656-aaab-efd9ffb71e0e]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_51n0n_ca {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:38 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_51n0n_ca Jul 19 13:15:38 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:38 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_51n0n_ca" returned: 0 in 0.488s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_51n0n_ca {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "cinder-a6f39b56-51e7-4f74-a8e4-15b189becc25-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-a6f39b56-51e7-4f74-a8e4-15b189becc25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "cinder-quobyte-e5bf6b33-42a4-4a84-a409-4041c62d71d8" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-quobyte-e5bf6b33-42a4-4a84-a409-4041c62d71d8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "cinder-quobyte-a6f39b56-51e7-4f74-a8e4-15b189becc25" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-quobyte-a6f39b56-51e7-4f74-a8e4-15b189becc25" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Deleting offline snapshot a6f39b56-51e7-4f74-a8e4-15b189becc25 of volume e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] snapshot_file for this snap is: volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324558e-6485-45e5-955c-458b9e078ff3]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:38 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_51n0n_ca Jul 19 13:15:38 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:38 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 Jul 19 13:15:38 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:38 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_51n0n_ca" returned: 1 in 0.518s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_51n0n_ca' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[faead240-9147-434f-a327-72dcf294a204]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:39 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD Jul 19 13:15:39 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:39 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25" returned: 0 in 0.531s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f299f-bec8-4039-bc34-96bbd9960af4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:39 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 Jul 19 13:15:39 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:39 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:39 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD Jul 19 13:15:39 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:39 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8" returned: 0 in 0.522s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:39 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 Jul 19 13:15:39 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:39 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD" returned: 1 in 0.535s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 was raw, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:15:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:40 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 Jul 19 13:15:40 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:40 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25" returned: 0 in 0.609s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:40 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25 Jul 19 13:15:40 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:40 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8.a6f39b56-51e7-4f74-a8e4-15b189becc25" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-quobyte-a6f39b56-51e7-4f74-a8e4-15b189becc25" released by "_delete_snapshot" :: held 2.196s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:40 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4" returned: 0 in 0.849s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5e8cc886-f01a-40de-a1d9-0b7a47d9a106_uexbmjgmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:15:40 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-quobyte-e5bf6b33-42a4-4a84-a409-4041c62d71d8" released by "delete_snapshot" :: held 2.266s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:40 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 1G Jul 19 13:15:40 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Created reservations ['c71f02df-f3b6-41e5-b878-0f88e566ea30', '760f8a9b-27a9-41df-946a-378c5e47b218', '6ffdbb96-ebc0-417b-a364-f4c59952c66d', 'c70f71f4-36be-40a1-9f68-18d38c6c2c05'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Delete snapshot completed successfully. Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4759e60c-0c31-40ab-b966-c39a3a58c5f8 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-a6f39b56-51e7-4f74-a8e4-15b189becc25-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:41 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 1G" returned: 0 in 0.460s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Downloaded image 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'metadata': {}}])) to volume b2d6b5fe-8782-47a1-b8a4-153a75a346a4 successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Temporary image 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 for user 0adb6e80bb194d078c147dde68957c2f is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Marking volume b2d6b5fe-8782-47a1-b8a4-153a75a346a4 as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Copying metadata from image 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 to b2d6b5fe-8782-47a1-b8a4-153a75a346a4. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Creating volume glance metadata for volume b2d6b5fe-8782-47a1-b8a4-153a75a346a4 backed by image 5e8cc886-f01a-40de-a1d9-0b7a47d9a106 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9f0d5e508ccda131756f42c7419e4153', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071c040b-4999-4386-920e-755b3b777fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4', 'volume_size': 1, 'image_id': '5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f0d5e508ccda131756f42c7419e4153', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9874fae061a64afea0195af91160ae65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39103bb50139fa7c445bcc0aeee17c0c3a3a25bb91ac9d3a626f999fa8a92e40f731aad5429a34d77cc8e29014636d244f49e609061db6227181c0d2dd70ebe6', 'id': '5e8cc886-f01a-40de-a1d9-0b7a47d9a106', 'created_at': datetime.datetime(2026, 7, 19, 11, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e8cc886-f01a-40de-a1d9-0b7a47d9a106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32cef07-4e6f-4149-af52-f0ca89ffa9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Volume volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 (b2d6b5fe-8782-47a1-b8a4-153a75a346a4): created successfully Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32cef07-4e6f-4149-af52-f0ca89ffa9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Flow 'volume_create_manager' (c6c1ab37-bf80-4982-ae86-d36ae34332ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bc613c43-352c-4870-a37f-b19b83c139c8 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Created volume successfully. Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "cinder-e5bf6b33-42a4-4a84-a409-4041c62d71d8-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-e5bf6b33-42a4-4a84-a409-4041c62d71d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "cinder-quobyte-e5bf6b33-42a4-4a84-a409-4041c62d71d8" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-quobyte-e5bf6b33-42a4-4a84-a409-4041c62d71d8" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Acquiring lock "cinder-b2d6b5fe-8782-47a1-b8a4-153a75a346a4-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d1ba4-f4a8-42bb-9aa2-212e20ae70bc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "cinder-b2d6b5fe-8782-47a1-b8a4-153a75a346a4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Acquiring lock "cinder-quobyte-b2d6b5fe-8782-47a1-b8a4-153a75a346a4" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "cinder-quobyte-b2d6b5fe-8782-47a1-b8a4-153a75a346a4" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a28d16-7b7a-4de0-98ff-bf8ab6c13c61]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:42 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 Jul 19 13:15:42 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:42 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 Jul 19 13:15:42 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:42 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8" returned: 0 in 0.439s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:42 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:42 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:42 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8 Jul 19 13:15:42 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:42 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4" returned: 0 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:42 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4 Jul 19 13:15:42 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:42 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:15:42 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5bf6b33-42a4-4a84-a409-4041c62d71d8" returned: 0 in 0.292s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-quobyte-e5bf6b33-42a4-4a84-a409-4041c62d71d8" released by "delete_volume" :: held 0.817s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Created reservations ['73e614e3-fb1d-4ac5-9443-eb5dc35d8e23', 'e7e1da6b-1a70-4fb3-b09f-41fe0b284561', 'd74f73b5-843d-45c8-8f33-9df79486b62d', 'f883fab7-c4be-4e17-b461-0a45705cf6cc'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:42 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2d6b5fe-8782-47a1-b8a4-153a75a346a4" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "cinder-quobyte-b2d6b5fe-8782-47a1-b8a4-153a75a346a4" released by "delete_volume" :: held 0.737s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:42 devstack cinder-volume[87305]: WARNING cinder.quota [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:15:42 devstack cinder-volume[87305]: WARNING cinder.quota [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:42 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:42 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:42 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Created reservations ['d902a2e9-b134-4725-9e91-34dabf899991', '204a0e06-f3ed-4089-87ae-41171bc80711', '6629fa82-9671-4d28-8bfc-f657abebd763', 'e2e7e5f2-fa2f-4971-9b74-577a4c3f4e03'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:43 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:43 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:43 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.401s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Deleted volume successfully. Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4b0e89cd-b871-4de0-bbad-77be46543c91 tempest-SnapshotMetadataTestJSON-727742669 None] Lock "cinder-e5bf6b33-42a4-4a84-a409-4041c62d71d8-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:43 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.355s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Deleted volume successfully. Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-61d4ee9b-9eff-4f0b-a3a0-fbebd71fb5e5 tempest-VolumeAndVolumeTypeFromImageTest-446776850 None] Lock "cinder-b2d6b5fe-8782-47a1-b8a4-153a75a346a4-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (7d966f82-988f-4699-8a1b-0288adb8d652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90902e4e-68dd-4f0a-994a-e0b1c069cc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90902e4e-68dd-4f0a-994a-e0b1c069cc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482144330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9371c5d7-3109-4aa7-8b8e-91b2acfb9930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:44Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986a79c5-4958-4a76-8121-41bcadfd58b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986a79c5-4958-4a76-8121-41bcadfd58b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bb55b1-4aee-4e79-afb9-037855bcd53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bb55b1-4aee-4e79-afb9-037855bcd53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9371c5d7-3109-4aa7-8b8e-91b2acfb9930', 'volume_name': 'volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6e081f-0e21-41aa-9c20-6a1c079f759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6e081f-0e21-41aa-9c20-6a1c079f759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d3d827-12e0-47ed-b838-410f06a4073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:43 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Volume 9371c5d7-3109-4aa7-8b8e-91b2acfb9930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930', 'volume_size': 1} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482144330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9371c5d7-3109-4aa7-8b8e-91b2acfb9930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:44Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Creating volume 9371c5d7-3109-4aa7-8b8e-91b2acfb9930 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:43 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:44 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 1073741824 Jul 19 13:15:44 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:44 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 1073741824" returned: 0 in 0.561s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:44 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 Jul 19 13:15:44 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:44 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930" returned: 0 in 0.287s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d3d827-12e0-47ed-b838-410f06a4073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1386ace9-5fc6-40f1-8f3f-4a7cb7c51409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:44 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Volume volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 (9371c5d7-3109-4aa7-8b8e-91b2acfb9930): created successfully Jul 19 13:15:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1386ace9-5fc6-40f1-8f3f-4a7cb7c51409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (7d966f82-988f-4699-8a1b-0288adb8d652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-07bf8bb0-b867-48ca-99f8-de694e908639 tempest-ProjectReaderTests-778300279 None] Created volume successfully. Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-9371c5d7-3109-4aa7-8b8e-91b2acfb9930-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Lock "cinder-9371c5d7-3109-4aa7-8b8e-91b2acfb9930-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-quobyte-9371c5d7-3109-4aa7-8b8e-91b2acfb9930" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-9371c5d7-3109-4aa7-8b8e-91b2acfb9930" acquired by "delete_volume" :: waited 0.046s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f798594a-f2ac-4284-b592-3853a0d467b1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:46 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 Jul 19 13:15:46 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:46 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930" returned: 0 in 0.427s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:46 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930 Jul 19 13:15:47 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:47 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9371c5d7-3109-4aa7-8b8e-91b2acfb9930" returned: 0 in 0.319s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-9371c5d7-3109-4aa7-8b8e-91b2acfb9930" released by "delete_volume" :: held 0.823s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Created reservations ['5c91dd39-e792-424a-a09e-d7af155d19d9', '58302d36-823e-499b-83fc-1f2a2659267b', '514cd69f-1369-4f5e-b15d-ac937800afa0', '53d1bcc2-e3b8-4a8b-9ab0-07ef174169e3'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:47 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:47 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:47 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Flow 'volume_create_manager' (21601d9b-525d-45f0-a12a-bc03cf91f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051c372a-8bf9-4d68-a0d9-73bd216b1f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.450s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051c372a-8bf9-4d68-a0d9-73bd216b1f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-182826852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb438e6f-82b9-4eb5-b363-e1ed775fcdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704b4e2e56df44c39ad413d92076fc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:48Z,use_quota=True,user_id='be4a7cfb711c412c8136623e207fed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846b563f-4f37-4de1-8682-5b8bcee52842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846b563f-4f37-4de1-8682-5b8bcee52842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5a786e-003b-4abc-9f0f-b6b6609d2870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5a786e-003b-4abc-9f0f-b6b6609d2870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb438e6f-82b9-4eb5-b363-e1ed775fcdd0', 'volume_name': 'volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3678c301-ed52-4cf1-8b29-4cdb9d1974d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3678c301-ed52-4cf1-8b29-4cdb9d1974d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633824ac-c690-4222-975d-57d739ae62d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Volume fb438e6f-82b9-4eb5-b363-e1ed775fcdd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0', 'volume_size': 1} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-182826852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb438e6f-82b9-4eb5-b363-e1ed775fcdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704b4e2e56df44c39ad413d92076fc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:48Z,use_quota=True,user_id='be4a7cfb711c412c8136623e207fed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Creating volume fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:48 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:48 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Deleted volume successfully. Jul 19 13:15:48 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 1073741824 Jul 19 13:15:48 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9c887ee3-d5fb-4db9-9863-f2e7822f7bb9 tempest-ProjectReaderTests-778300279 None] Lock "cinder-9371c5d7-3109-4aa7-8b8e-91b2acfb9930-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (62eb2282-15c7-4903-98ab-fcf995b67247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b92d96-bd2d-44db-a790-9a84f7c259b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b92d96-bd2d-44db-a790-9a84f7c259b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707796701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9f1197-f718-4a41-88b4-0788f7009131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:48Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869a4e58-a90f-48b7-993b-6be1c6ce9273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869a4e58-a90f-48b7-993b-6be1c6ce9273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1802d6f6-f621-4235-a490-4ea4a46ba5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1802d6f6-f621-4235-a490-4ea4a46ba5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9f1197-f718-4a41-88b4-0788f7009131', 'volume_name': 'volume-cd9f1197-f718-4a41-88b4-0788f7009131', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d1d5c9-ae83-4bc2-8db8-03bad3f2f685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d1d5c9-ae83-4bc2-8db8-03bad3f2f685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f071857b-8e1a-420f-9509-e9f967bd9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:48 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Volume cd9f1197-f718-4a41-88b4-0788f7009131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9f1197-f718-4a41-88b4-0788f7009131', 'volume_size': 1} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:48 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 1073741824" returned: 0 in 0.572s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:48 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 Jul 19 13:15:48 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:48 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0" returned: 0 in 0.280s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707796701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9f1197-f718-4a41-88b4-0788f7009131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:48Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Creating volume cd9f1197-f718-4a41-88b4-0788f7009131 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:49 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633824ac-c690-4222-975d-57d739ae62d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:49 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 1073741824 Jul 19 13:15:49 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecfeeb5-ab23-45bf-9107-06cd50e5bc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:49 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Volume volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 (fb438e6f-82b9-4eb5-b363-e1ed775fcdd0): created successfully Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecfeeb5-ab23-45bf-9107-06cd50e5bc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Flow 'volume_create_manager' (21601d9b-525d-45f0-a12a-bc03cf91f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:49 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-046bde73-c545-42f8-8e9b-81116bd7b7d8 tempest-AbsoluteLimitsTests-1303925089 None] Created volume successfully. Jul 19 13:15:49 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 1073741824" returned: 0 in 0.468s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:49 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 Jul 19 13:15:49 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:49 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131" returned: 0 in 0.278s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f071857b-8e1a-420f-9509-e9f967bd9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9f1197-f718-4a41-88b4-0788f7009131', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100c724d-b411-4814-9bd1-4efdd45063fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:49 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Volume volume-cd9f1197-f718-4a41-88b4-0788f7009131 (cd9f1197-f718-4a41-88b4-0788f7009131): created successfully Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100c724d-b411-4814-9bd1-4efdd45063fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (62eb2282-15c7-4903-98ab-fcf995b67247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:49 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-be43596b-905d-4695-bb3f-1ac0f56379d2 tempest-ProjectReaderTests-778300279 None] Created volume successfully. Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Acquiring lock "cinder-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Lock "cinder-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Acquiring lock "cinder-quobyte-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Lock "cinder-quobyte-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26f409d-1eb0-429f-b7a2-4f4d950ef333]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-cd9f1197-f718-4a41-88b4-0788f7009131-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Lock "cinder-cd9f1197-f718-4a41-88b4-0788f7009131-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:50 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 Jul 19 13:15:50 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-quobyte-cd9f1197-f718-4a41-88b4-0788f7009131" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-cd9f1197-f718-4a41-88b4-0788f7009131" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aed035-9646-41f6-b45e-f4b4b544ebc2]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:50 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 Jul 19 13:15:50 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:50 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0" returned: 0 in 0.544s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:50 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0 Jul 19 13:15:50 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:51 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131" returned: 0 in 0.498s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:51 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131 Jul 19 13:15:51 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:51 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0" returned: 0 in 0.396s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Lock "cinder-quobyte-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0" released by "delete_volume" :: held 1.010s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Created reservations ['ab490cee-7319-4dd9-b742-5f5b1f9eba2f', 'f6940958-956a-43d1-bc0a-502c2296d0f8', '7d46f3e3-ff98-4e1c-ba3a-ffcd11035d81', '40b04b58-ecec-4255-aed7-8783ff7b5efc'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:51 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cd9f1197-f718-4a41-88b4-0788f7009131" returned: 0 in 0.392s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-cd9f1197-f718-4a41-88b4-0788f7009131" released by "delete_volume" :: held 0.965s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:51 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:51 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Created reservations ['fb369924-9ce3-4769-862d-9363c7a18434', '85ec6647-9347-4d5d-9ff5-e5874c734096', 'f682235f-23a1-4415-b02f-154e6f4c0a8c', 'abd71234-0b29-4f19-a9bf-b2ad4e0d5116'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:51 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:51 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:52 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.606s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:52 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:52 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Deleted volume successfully. Jul 19 13:15:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6880b43a-1a8a-4ea8-beee-46691634933f tempest-AbsoluteLimitsTests-1303925089 None] Lock "cinder-fb438e6f-82b9-4eb5-b363-e1ed775fcdd0-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:52 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.432s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:52 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:52 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Deleted volume successfully. Jul 19 13:15:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-441141b6-b27f-41a9-88f5-aa4f5fe71f2e tempest-ProjectReaderTests-778300279 None] Lock "cinder-cd9f1197-f718-4a41-88b4-0788f7009131-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (78fde955-bdbc-41cf-8ba6-2ed4b249c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62dfbe4c-2f0c-45db-9162-840c9723f99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62dfbe4c-2f0c-45db-9162-840c9723f99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497138727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2845cd9-2de4-49a2-bab7-af97670cae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:53Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24db7f19-d279-4606-91ce-45c1c8a4526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24db7f19-d279-4606-91ce-45c1c8a4526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6413af5c-6fd8-4369-91f5-7701e52540fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6413af5c-6fd8-4369-91f5-7701e52540fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2845cd9-2de4-49a2-bab7-af97670cae98', 'volume_name': 'volume-b2845cd9-2de4-49a2-bab7-af97670cae98', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd12f85-0414-421d-ab96-8a774980edac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd12f85-0414-421d-ab96-8a774980edac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e9146e-cfa6-4ac7-86c8-7e0bb7d0ee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:53 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Volume b2845cd9-2de4-49a2-bab7-af97670cae98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2845cd9-2de4-49a2-bab7-af97670cae98', 'volume_size': 1} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497138727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2845cd9-2de4-49a2-bab7-af97670cae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:53Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Creating volume b2845cd9-2de4-49a2-bab7-af97670cae98 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:53 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:53 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 1073741824 Jul 19 13:15:53 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-d77cac09-d73b-424a-a344-735725f98f80 tempest-TestShelveInstance-2000878765 None] Terminate volume connection completed successfully. Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-d77cac09-d73b-424a-a344-735725f98f80 tempest-TestShelveInstance-2000878765 None] Deleting attachment 06d8da18-24a7-4f2c-b8bd-2953aa51c53f. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:15:54 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 1073741824" returned: 0 in 0.557s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:54 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 Jul 19 13:15:54 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Acquiring lock "cinder-c559c66f-0baa-4520-956c-6b95620cf5d1-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Lock "cinder-c559c66f-0baa-4520-956c-6b95620cf5d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Acquiring lock "cinder-quobyte-c559c66f-0baa-4520-956c-6b95620cf5d1" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Lock "cinder-quobyte-c559c66f-0baa-4520-956c-6b95620cf5d1" acquired by "delete_volume" :: waited 0.041s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0600fd15-2b03-4e37-bfa3-8252e889147a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:54 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98" returned: 0 in 0.386s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e9146e-cfa6-4ac7-86c8-7e0bb7d0ee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2845cd9-2de4-49a2-bab7-af97670cae98', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541ee5b4-1515-4f7e-8f0b-d7ef490f4deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:54 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Volume volume-b2845cd9-2de4-49a2-bab7-af97670cae98 (b2845cd9-2de4-49a2-bab7-af97670cae98): created successfully Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541ee5b4-1515-4f7e-8f0b-d7ef490f4deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (78fde955-bdbc-41cf-8ba6-2ed4b249c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-463be369-9795-4107-bf19-107121367774 tempest-ProjectReaderTests-778300279 None] Created volume successfully. Jul 19 13:15:54 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 Jul 19 13:15:54 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:54 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1" returned: 0 in 0.455s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:55 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1 Jul 19 13:15:55 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:55 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c559c66f-0baa-4520-956c-6b95620cf5d1" returned: 0 in 0.296s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Lock "cinder-quobyte-c559c66f-0baa-4520-956c-6b95620cf5d1" released by "delete_volume" :: held 0.829s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.quota [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Created reservations ['7becbbab-21ae-4c9b-a439-67a32a91b1b9', '1848df33-8fa9-4de1-a2c2-d06c0356600b', '32bc546a-8fc5-45c5-9fda-260f0de3534d', '52685833-68f6-4896-ba43-fd00effe05a9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:55 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:55 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-b2845cd9-2de4-49a2-bab7-af97670cae98-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Lock "cinder-b2845cd9-2de4-49a2-bab7-af97670cae98-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-quobyte-b2845cd9-2de4-49a2-bab7-af97670cae98" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-b2845cd9-2de4-49a2-bab7-af97670cae98" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ec011-db15-4827-a8b7-5c9474b34de5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:55 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.331s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.manager [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Deleted volume successfully. Jul 19 13:15:55 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 Jul 19 13:15:55 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [req-f7766c10-c653-4c85-a1b8-37fbf4a7030d req-a0e4bca3-9111-4070-a02c-09c5489ca077 tempest-TestShelveInstance-2000878765 None] Lock "cinder-c559c66f-0baa-4520-956c-6b95620cf5d1-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:56 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98" returned: 0 in 0.419s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:56 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98 Jul 19 13:15:56 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:56 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b2845cd9-2de4-49a2-bab7-af97670cae98" returned: 0 in 0.294s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-b2845cd9-2de4-49a2-bab7-af97670cae98" released by "delete_volume" :: held 0.776s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Created reservations ['19468bb9-a65e-45f7-aca3-8e50ebb6a310', '7d7440cc-af2a-4952-b55a-2d64d23033e2', 'b25ac0d9-76b4-4867-80e8-99d57dd95d28', '656a8e93-962f-4c76-8382-09d9160c9c9b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:56 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:15:56 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:56 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.291s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:15:56 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Deleted volume successfully. Jul 19 13:15:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edd8165e-0a61-422b-a306-0562344e755d tempest-ProjectReaderTests-778300279 None] Lock "cinder-b2845cd9-2de4-49a2-bab7-af97670cae98-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (aaaceb22-1d3e-4ba2-b97d-d13224c8f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2c7595-c3af-4cfb-9c8c-067ef072ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2c7595-c3af-4cfb-9c8c-067ef072ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630483657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc645fa1-ae7e-4fde-909c-b3745666e0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:57Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca45954-41f6-4dd9-8592-b7196fe4c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca45954-41f6-4dd9-8592-b7196fe4c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74301f43-7b96-4a52-98cf-af058524b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74301f43-7b96-4a52-98cf-af058524b13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc645fa1-ae7e-4fde-909c-b3745666e0aa', 'volume_name': 'volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7e65b3-1893-4182-9474-3a59f01043a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7e65b3-1893-4182-9474-3a59f01043a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03fb811-26e6-4ff1-81bd-3c6476719a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Volume fc645fa1-ae7e-4fde-909c-b3745666e0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa', 'volume_size': 1} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630483657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc645fa1-ae7e-4fde-909c-b3745666e0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a140acfbdd467ba5d0d5e70e97887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:57Z,use_quota=True,user_id='e7685697a3254cd48bc92fcb6853143a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Creating volume fc645fa1-ae7e-4fde-909c-b3745666e0aa {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:57 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:57 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa 1073741824 Jul 19 13:15:57 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Flow 'volume_create_manager' (bec0851a-2acf-4158-801a-670abddb4710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ede9be-e477-4064-a036-59f5730bddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ede9be-e477-4064-a036-59f5730bddbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1280533788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14da5242-90b4-41d5-a772-bfe1e817aaf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2364394de14d3cafc81b622f0468c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:58Z,use_quota=True,user_id='f903ce9d36a344e3a6ee13bdebea07b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a867013-d858-44bc-83cd-a3dabe143052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a867013-d858-44bc-83cd-a3dabe143052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22aec23b-7501-499c-8925-5a8585db0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22aec23b-7501-499c-8925-5a8585db0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14da5242-90b4-41d5-a772-bfe1e817aaf4', 'volume_name': 'volume-14da5242-90b4-41d5-a772-bfe1e817aaf4', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412c6ae4-fa22-4c3c-9e8f-5ee952c0a2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412c6ae4-fa22-4c3c-9e8f-5ee952c0a2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d408d-69e4-4f7c-a3fe-0acc282e616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Volume 14da5242-90b4-41d5-a772-bfe1e817aaf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14da5242-90b4-41d5-a772-bfe1e817aaf4', 'volume_size': 1} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:57 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa 1073741824" returned: 0 in 0.497s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:57 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa Jul 19 13:15:57 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:58 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1280533788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14da5242-90b4-41d5-a772-bfe1e817aaf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2364394de14d3cafc81b622f0468c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:15:58Z,use_quota=True,user_id='f903ce9d36a344e3a6ee13bdebea07b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Creating volume 14da5242-90b4-41d5-a772-bfe1e817aaf4 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:15:58 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03fb811-26e6-4ff1-81bd-3c6476719a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3bcf49-af39-4364-9856-0c8d950999e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:58 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 1073741824 Jul 19 13:15:58 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Volume volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa (fc645fa1-ae7e-4fde-909c-b3745666e0aa): created successfully Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3bcf49-af39-4364-9856-0c8d950999e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Flow 'volume_create_manager' (aaaceb22-1d3e-4ba2-b97d-d13224c8f29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4bd71a9a-84b7-453c-a6f8-dce829f5f726 tempest-ProjectReaderTests-778300279 None] Created volume successfully. Jul 19 13:15:58 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 1073741824" returned: 0 in 0.446s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:58 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 Jul 19 13:15:58 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:58 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d408d-69e4-4f7c-a3fe-0acc282e616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14da5242-90b4-41d5-a772-bfe1e817aaf4', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011caa65-7910-4277-9763-6d67d8ded234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:15:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Volume volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 (14da5242-90b4-41d5-a772-bfe1e817aaf4): created successfully Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011caa65-7910-4277-9763-6d67d8ded234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:15:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Flow 'volume_create_manager' (bec0851a-2acf-4158-801a-670abddb4710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:15:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-437cd570-3c24-43f8-85aa-b0ec097e3ecd tempest-VolumesMetadataTest-1384220803 None] Created volume successfully. Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-fc645fa1-ae7e-4fde-909c-b3745666e0aa-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Lock "cinder-fc645fa1-ae7e-4fde-909c-b3745666e0aa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Acquiring lock "cinder-quobyte-fc645fa1-ae7e-4fde-909c-b3745666e0aa" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-fc645fa1-ae7e-4fde-909c-b3745666e0aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c3ca18-1787-44e5-b9c6-46f9366a1a42]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:59 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa Jul 19 13:15:59 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:15:59 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa" returned: 0 in 0.466s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:15:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:15:59 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa Jul 19 13:15:59 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:00 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-fc645fa1-ae7e-4fde-909c-b3745666e0aa" returned: 0 in 0.315s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Lock "cinder-quobyte-fc645fa1-ae7e-4fde-909c-b3745666e0aa" released by "delete_volume" :: held 0.823s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Created reservations ['0f363a72-130a-42cd-94a9-33703443f8ce', '16a7c2a2-6004-4d72-9a0f-5baab91e1a7a', 'ba2dee95-8b79-4a6e-9a44-30ae2a3f8484', 'cbcdac54-014b-45ca-bfc0-4d71bbb27bca'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:00 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:00 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Acquiring lock "cinder-14da5242-90b4-41d5-a772-bfe1e817aaf4-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Lock "cinder-14da5242-90b4-41d5-a772-bfe1e817aaf4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:00 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.309s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Deleted volume successfully. Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Acquiring lock "cinder-quobyte-14da5242-90b4-41d5-a772-bfe1e817aaf4" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-24095153-c6f1-4302-b682-685127f56ead tempest-ProjectReaderTests-778300279 None] Lock "cinder-fc645fa1-ae7e-4fde-909c-b3745666e0aa-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Lock "cinder-quobyte-14da5242-90b4-41d5-a772-bfe1e817aaf4" acquired by "delete_volume" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7114c-7ea3-4672-9140-07fdf7abd4fd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:00 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 Jul 19 13:16:00 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:01 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4" returned: 0 in 0.399s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:01 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4 Jul 19 13:16:01 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:01 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-14da5242-90b4-41d5-a772-bfe1e817aaf4" returned: 0 in 0.268s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Lock "cinder-quobyte-14da5242-90b4-41d5-a772-bfe1e817aaf4" released by "delete_volume" :: held 0.747s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Created reservations ['49e15fb9-7708-48c0-8ed6-9249e801f3ec', 'b1b68632-94b0-47ac-b6af-56d6fc0fc456', 'bd3cb57e-e208-4027-a3c0-83909e15bd55', 'bedb1d63-e678-4d60-ab3d-fe7aa7a94d3e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:01 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:01 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:02 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.292s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:02 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:02 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Deleted volume successfully. Jul 19 13:16:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-77ca943f-5d83-411f-9357-08fd1a2e8967 tempest-VolumesMetadataTest-1384220803 None] Lock "cinder-14da5242-90b4-41d5-a772-bfe1e817aaf4-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=165,cinder:INSERT=70,cinder:UPDATE=219,cinder:DELETE=18 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Flow 'volume_create_manager' (e3cf65ff-6a22-4da7-b1a4-d38854510b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04462cfc-b5aa-4dda-8e96-834994941b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04462cfc-b5aa-4dda-8e96-834994941b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-990828014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d7c6b6-7467-4877-895d-a3344e576ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799edfb6a264d4fbeba394abc6e67a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:05Z,use_quota=True,user_id='3b0aa1005129498f9a8f277c0c71e89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba98e11-8fc7-46ed-8e6f-74a46901072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba98e11-8fc7-46ed-8e6f-74a46901072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd639525-bbac-4141-b4be-7b76383eb86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd639525-bbac-4141-b4be-7b76383eb86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d7c6b6-7467-4877-895d-a3344e576ab7', 'volume_name': 'volume-b9d7c6b6-7467-4877-895d-a3344e576ab7', 'volume_size': 2}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df29e09-b208-41c7-bd77-5143abbffbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df29e09-b208-41c7-bd77-5143abbffbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9c39d9-a535-4bf2-a37b-6b8d3c77bffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:05 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Volume b9d7c6b6-7467-4877-895d-a3344e576ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d7c6b6-7467-4877-895d-a3344e576ab7', 'volume_size': 2} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-990828014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d7c6b6-7467-4877-895d-a3344e576ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799edfb6a264d4fbeba394abc6e67a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:05Z,use_quota=True,user_id='3b0aa1005129498f9a8f277c0c71e89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Creating volume b9d7c6b6-7467-4877-895d-a3344e576ab7 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:05 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 2147483648 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:05 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 2147483648 Jul 19 13:16:05 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:05 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 2147483648" returned: 0 in 0.482s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:05 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 Jul 19 13:16:05 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:06 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7" returned: 0 in 0.271s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9c39d9-a535-4bf2-a37b-6b8d3c77bffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d7c6b6-7467-4877-895d-a3344e576ab7', 'volume_size': 2}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce9c548-c807-4a0a-8eb1-f5c371ab3f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:06 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Volume volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 (b9d7c6b6-7467-4877-895d-a3344e576ab7): created successfully Jul 19 13:16:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce9c548-c807-4a0a-8eb1-f5c371ab3f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Flow 'volume_create_manager' (e3cf65ff-6a22-4da7-b1a4-d38854510b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-592836f6-af6a-41be-ac47-ccada54b1eaa tempest-VolumesCloneNegativeTest-652037567 None] Created volume successfully. Jul 19 13:16:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Acquiring lock "cinder-b9d7c6b6-7467-4877-895d-a3344e576ab7-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Lock "cinder-b9d7c6b6-7467-4877-895d-a3344e576ab7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Acquiring lock "cinder-quobyte-b9d7c6b6-7467-4877-895d-a3344e576ab7" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Lock "cinder-quobyte-b9d7c6b6-7467-4877-895d-a3344e576ab7" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:07 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d4a195-bf62-4321-ab84-1530f216c98d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:07 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 Jul 19 13:16:07 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:08 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7" returned: 0 in 0.364s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:08 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7 Jul 19 13:16:08 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:08 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b9d7c6b6-7467-4877-895d-a3344e576ab7" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:INSERT=51,cinder:UPDATE=189,cinder:SELECT=154,cinder:DELETE=15 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Lock "cinder-quobyte-b9d7c6b6-7467-4877-895d-a3344e576ab7" released by "delete_volume" :: held 0.687s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (0564d9f7-9078-46ff-8890-3d190f68a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f82341-ca88-40dc-867a-d88c68f2d211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f82341-ca88-40dc-867a-d88c68f2d211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258931684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22edf48-918c-4c91-806c-79cd764aaefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:08Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb3cd0d-a6df-4af0-bf5e-08fd84a7abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb3cd0d-a6df-4af0-bf5e-08fd84a7abd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c45843-294d-4b55-8022-7f08bb178996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c45843-294d-4b55-8022-7f08bb178996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22edf48-918c-4c91-806c-79cd764aaefa', 'volume_name': 'volume-a22edf48-918c-4c91-806c-79cd764aaefa', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1edcbba-d2e8-4d97-8299-8704add70a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1edcbba-d2e8-4d97-8299-8704add70a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90467ac8-733c-4202-b65e-c9eae4e3f842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:08 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume a22edf48-918c-4c91-806c-79cd764aaefa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22edf48-918c-4c91-806c-79cd764aaefa', 'volume_size': 1} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258931684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22edf48-918c-4c91-806c-79cd764aaefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:08Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Creating volume a22edf48-918c-4c91-806c-79cd764aaefa {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:08 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:08 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa 1073741824 Jul 19 13:16:08 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Created reservations ['ab2f7207-4a7d-45b9-aeab-0ce88c826761', 'd7f91fec-ac1e-4aab-bfbd-ca6234fc0f87', '8a5cceda-1bb8-4d26-a7d2-cc3162697424', '8025ad6e-06e4-4ea9-a6b2-dff5fc448829'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:08 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:08 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:08 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.255s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Deleted volume successfully. Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4d4bd129-aad9-47fb-843f-2bbe4f30bef7 tempest-VolumesCloneNegativeTest-652037567 None] Lock "cinder-b9d7c6b6-7467-4877-895d-a3344e576ab7-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:08 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa 1073741824" returned: 0 in 0.476s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:08 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa Jul 19 13:16:08 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:09 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa" returned: 0 in 0.246s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90467ac8-733c-4202-b65e-c9eae4e3f842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22edf48-918c-4c91-806c-79cd764aaefa', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68908a-e5d8-44c1-bbac-24951a891052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:09 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume volume-a22edf48-918c-4c91-806c-79cd764aaefa (a22edf48-918c-4c91-806c-79cd764aaefa): created successfully Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68908a-e5d8-44c1-bbac-24951a891052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (0564d9f7-9078-46ff-8890-3d190f68a96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:09 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-59cbc505-a3fb-41ac-9df9-0f288056dd19 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created volume successfully. Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (cfa32676-921b-4ed0-acef-947a12936e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6205350a-30b0-491a-902f-f3eb6f46debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6205350a-30b0-491a-902f-f3eb6f46debb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812619030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c029ba7d-e17f-481c-af57-9b6e20a2317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:10Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c970ae68-d5a7-43ea-b865-86f4882baf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c970ae68-d5a7-43ea-b865-86f4882baf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61484b9e-be20-4e9e-81d2-d9257d8bad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61484b9e-be20-4e9e-81d2-d9257d8bad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c029ba7d-e17f-481c-af57-9b6e20a2317f', 'volume_name': 'volume-c029ba7d-e17f-481c-af57-9b6e20a2317f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e57b30-0ce8-4ccd-b3cf-0b843d6bcf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e57b30-0ce8-4ccd-b3cf-0b843d6bcf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d3133d-4c7e-486e-89c7-049b874f727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:09 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume c029ba7d-e17f-481c-af57-9b6e20a2317f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c029ba7d-e17f-481c-af57-9b6e20a2317f', 'volume_size': 1} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812619030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c029ba7d-e17f-481c-af57-9b6e20a2317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:10Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Creating volume c029ba7d-e17f-481c-af57-9b6e20a2317f {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:09 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:09 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f 1073741824 Jul 19 13:16:09 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (e904337c-c376-4307-b883-17277ef22bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163b8056-734d-4d6e-9491-47b453dd272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163b8056-734d-4d6e-9491-47b453dd272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59410837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb6b5fc-3a92-4227-956a-4b74a615fa79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:10Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4b8a63-b10c-4d9a-be6e-09cf6d8e9cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4b8a63-b10c-4d9a-be6e-09cf6d8e9cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206fb3b8-1feb-41af-8d1d-7b31f2efb3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206fb3b8-1feb-41af-8d1d-7b31f2efb3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb6b5fc-3a92-4227-956a-4b74a615fa79', 'volume_name': 'volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7a0c31-1e83-4110-82be-1da170b10cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7a0c31-1e83-4110-82be-1da170b10cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc912e4-354d-4b65-8c2c-e8ecc668047f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume 5bb6b5fc-3a92-4227-956a-4b74a615fa79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79', 'volume_size': 1} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:10 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f 1073741824" returned: 0 in 0.671s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:10 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f Jul 19 13:16:10 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (6ddb5fc4-9767-4542-916d-3ad0bc4df3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d61c10-55aa-4a3b-b55a-c680720c3cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d61c10-55aa-4a3b-b55a-c680720c3cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1607474558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcee607-04b0-42d4-a0b4-3fcf67deb121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:11Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabbd2f-94ca-4207-96f3-a610c32f34d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabbd2f-94ca-4207-96f3-a610c32f34d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d10cde-b1ee-4d4e-82cc-43e53e30bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d10cde-b1ee-4d4e-82cc-43e53e30bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcee607-04b0-42d4-a0b4-3fcf67deb121', 'volume_name': 'volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45e5161-55e8-47f3-9244-99d550a88bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45e5161-55e8-47f3-9244-99d550a88bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ed8d2a-3c81-4125-89b1-662e700f0574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume 9dcee607-04b0-42d4-a0b4-3fcf67deb121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121', 'volume_size': 1} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:10 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f" returned: 0 in 0.336s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59410837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb6b5fc-3a92-4227-956a-4b74a615fa79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:10Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Creating volume 5bb6b5fc-3a92-4227-956a-4b74a615fa79 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:10 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d3133d-4c7e-486e-89c7-049b874f727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c029ba7d-e17f-481c-af57-9b6e20a2317f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 1073741824 Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06f0a45-174e-44c7-b7d3-54ae37cf0312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume volume-c029ba7d-e17f-481c-af57-9b6e20a2317f (c029ba7d-e17f-481c-af57-9b6e20a2317f): created successfully Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06f0a45-174e-44c7-b7d3-54ae37cf0312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (cfa32676-921b-4ed0-acef-947a12936e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9b4b901f-74f0-4e49-b785-4b5dd5f345b4 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created volume successfully. Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (312c1656-6212-4ef8-bdbe-f73bfb13e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77093311-e127-42d3-aa1b-cece41fddf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77093311-e127-42d3-aa1b-cece41fddf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858820129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e50a12-b836-40d8-9634-45a2b12d2bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:11Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57b86dd-6907-40e6-92ff-869abe1b293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57b86dd-6907-40e6-92ff-869abe1b293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6018a47b-5e4f-4b04-8de0-45dd4052e76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6018a47b-5e4f-4b04-8de0-45dd4052e76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e50a12-b836-40d8-9634-45a2b12d2bac', 'volume_name': 'volume-b0e50a12-b836-40d8-9634-45a2b12d2bac', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e4716c-6c46-41b6-8279-91a865416f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e4716c-6c46-41b6-8279-91a865416f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e53ab20-a4b2-4042-a265-af1913574883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume b0e50a12-b836-40d8-9634-45a2b12d2bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e50a12-b836-40d8-9634-45a2b12d2bac', 'volume_size': 1} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (2145f1b8-50f1-4970-9c57-c50d0ca8bf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef795db-ad35-4923-a59f-54f96a092bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef795db-ad35-4923-a59f-54f96a092bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856056769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95002118-299e-40dd-baf1-53b3e4ffa4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:11Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ac1c73-4aeb-44b4-845d-aa82031184fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ac1c73-4aeb-44b4-845d-aa82031184fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd6478a-9fa7-49c0-9596-31fd72b1bf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd6478a-9fa7-49c0-9596-31fd72b1bf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95002118-299e-40dd-baf1-53b3e4ffa4b2', 'volume_name': 'volume-95002118-299e-40dd-baf1-53b3e4ffa4b2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d94766a-7af7-43ca-b063-19a1aa2d7ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d94766a-7af7-43ca-b063-19a1aa2d7ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16eb102-025d-4720-8e6d-44bb373da501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume 95002118-299e-40dd-baf1-53b3e4ffa4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95002118-299e-40dd-baf1-53b3e4ffa4b2', 'volume_size': 1} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 1073741824" returned: 0 in 0.633s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:11 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 Jul 19 13:16:11 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:11 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.110s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1607474558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcee607-04b0-42d4-a0b4-3fcf67deb121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:11Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Creating volume 9dcee607-04b0-42d4-a0b4-3fcf67deb121 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:11 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc912e4-354d-4b65-8c2c-e8ecc668047f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 1073741824 Jul 19 13:16:11 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc8105f-8f95-42da-9202-369a87329d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 (5bb6b5fc-3a92-4227-956a-4b74a615fa79): created successfully Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc8105f-8f95-42da-9202-369a87329d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (e904337c-c376-4307-b883-17277ef22bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0e3669ad-03e4-42ee-bb4e-63f79b966b3f tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created volume successfully. Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Flow 'volume_create_manager' (64ad22d4-c9b6-44ce-820f-93acc30ac82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bf2169-acaf-46b5-a908-2849024be866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:12 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 1073741824" returned: 0 in 0.451s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bf2169-acaf-46b5-a908-2849024be866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-272805413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898af1b8-fe30-4820-ab91-c9f4a0bd88a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647060144a3f498eb75de92daa609b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:12Z,use_quota=True,user_id='63d9f6de00144decac8df9846ae65516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b705edb-161e-4554-a3f2-3d266f45bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b705edb-161e-4554-a3f2-3d266f45bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a3d7b8-c4ff-48b9-b25c-7bb8ca6db287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:12 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 Jul 19 13:16:12 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a3d7b8-c4ff-48b9-b25c-7bb8ca6db287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '898af1b8-fe30-4820-ab91-c9f4a0bd88a6', 'volume_name': 'volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e135bc1-8e4f-4a97-9b9b-4d4bb09b5fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e135bc1-8e4f-4a97-9b9b-4d4bb09b5fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67981af4-886c-4556-824b-7533dce4ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:12 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Volume 898af1b8-fe30-4820-ab91-c9f4a0bd88a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Trying to clone 898af1b8-fe30-4820-ab91-c9f4a0bd88a6 from image 97bba3f0-2950-4456-be46-6a90be277718 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:16:12 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858820129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e50a12-b836-40d8-9634-45a2b12d2bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:11Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Creating volume b0e50a12-b836-40d8-9634-45a2b12d2bac {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:12 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:12 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac 1073741824 Jul 19 13:16:12 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ed8d2a-3c81-4125-89b1-662e700f0574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474b87e5-a066-4bb1-b56e-5658c40f3986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:12 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 (9dcee607-04b0-42d4-a0b4-3fcf67deb121): created successfully Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474b87e5-a066-4bb1-b56e-5658c40f3986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (6ddb5fc4-9767-4542-916d-3ad0bc4df3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-af811365-be75-4cff-9dbd-b93229aded62 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created volume successfully. Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:16:12 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Image download 20.69 MB at 20.69 MB/s Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc84934-82bf-4a71-8c87-e2b1412575e1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:13 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD Jul 19 13:16:13 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:13 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac 1073741824" returned: 0 in 0.463s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:13 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac Jul 19 13:16:13 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:13 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 is fetched for user 63d9f6de00144decac8df9846ae65516. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[240a84c8-6d82-4f1e-807b-71b561b64005]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:13 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac" returned: 0 in 0.258s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856056769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95002118-299e-40dd-baf1-53b3e4ffa4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf2181500e2475ba9d41172012aca1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:11Z,use_quota=True,user_id='49502cafd8c74bf6a328bf5ec4cc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Creating volume 95002118-299e-40dd-baf1-53b3e4ffa4b2 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:13 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e53ab20-a4b2-4042-a265-af1913574883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e50a12-b836-40d8-9634-45a2b12d2bac', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:13 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 1073741824 Jul 19 13:16:13 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68e27e4-3481-4550-aaff-54d96f415157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:13 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume volume-b0e50a12-b836-40d8-9634-45a2b12d2bac (b0e50a12-b836-40d8-9634-45a2b12d2bac): created successfully Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68e27e4-3481-4550-aaff-54d96f415157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:13 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD Jul 19 13:16:13 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (312c1656-6212-4ef8-bdbe-f73bfb13e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6a2c4bfb-ca72-4814-91fc-28f0b5770b70 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created volume successfully. Jul 19 13:16:13 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:13 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 1073741824" returned: 0 in 0.449s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:13 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 Jul 19 13:16:13 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:14 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-272805413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898af1b8-fe30-4820-ab91-c9f4a0bd88a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647060144a3f498eb75de92daa609b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:12Z,use_quota=True,user_id='63d9f6de00144decac8df9846ae65516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Creating volume 898af1b8-fe30-4820-ab91-c9f4a0bd88a6 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:14 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16eb102-025d-4720-8e6d-44bb373da501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95002118-299e-40dd-baf1-53b3e4ffa4b2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:14 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 1073741824 Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd410b95-ea87-4824-b987-38866682e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:14 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Volume volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 (95002118-299e-40dd-baf1-53b3e4ffa4b2): created successfully Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd410b95-ea87-4824-b987-38866682e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Flow 'volume_create_manager' (2145f1b8-50f1-4970-9c57-c50d0ca8bf7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7e210aac-a712-4355-a8d9-cc812e388178 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created volume successfully. Jul 19 13:16:14 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 1073741824" returned: 0 in 0.412s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:14 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 Jul 19 13:16:14 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:14 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Attempting download of 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume 898af1b8-fe30-4820-ab91-c9f4a0bd88a6. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-95002118-299e-40dd-baf1-53b3e4ffa4b2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-95002118-299e-40dd-baf1-53b3e4ffa4b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8b07fe-a25a-4f03-b569-f48fecec7ae1]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_p0he93zt {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-quobyte-95002118-299e-40dd-baf1-53b3e4ffa4b2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-95002118-299e-40dd-baf1-53b3e4ffa4b2" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[928f09e0-38be-48dc-b1b0-bc7550064588]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:15 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_p0he93zt Jul 19 13:16:15 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:15 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 Jul 19 13:16:15 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:15 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_p0he93zt" returned: 0 in 0.329s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_p0he93zt {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:15 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_p0he93zt Jul 19 13:16:15 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:15 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:15 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2 Jul 19 13:16:15 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:15 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_p0he93zt" returned: 1 in 0.328s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bba3f0-2950-4456-be46-6a90be277718_p0he93zt' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9931bcad-9062-4af3-8f74-8584f53b86e0]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:15 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-95002118-299e-40dd-baf1-53b3e4ffa4b2" returned: 0 in 0.241s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-95002118-299e-40dd-baf1-53b3e4ffa4b2" released by "delete_volume" :: held 0.661s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:15 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD Jul 19 13:16:15 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created reservations ['8d936be4-0b84-494b-b24a-489f5d5c33a7', '9eae37e2-fa4f-4da0-b32e-fc65fa1b88bf', '90fe18e7-a96b-4174-9ed6-717c2eb6c1b4', '6604d105-5b38-4840-a087-7ddff8291979'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:15 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:15 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:15 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] 97bba3f0-2950-4456-be46-6a90be277718 was qcow2, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:16:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:16 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 Jul 19 13:16:16 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:16 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Deleted volume successfully. Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-b0e50a12-b836-40d8-9634-45a2b12d2bac-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4b90635-ed3b-4739-a51c-bf5077a6ad28 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-95002118-299e-40dd-baf1-53b3e4ffa4b2-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-b0e50a12-b836-40d8-9634-45a2b12d2bac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-quobyte-b0e50a12-b836-40d8-9634-45a2b12d2bac" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-b0e50a12-b836-40d8-9634-45a2b12d2bac" acquired by "delete_volume" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7264d-8e2e-4c67-93f4-136a2b9c513b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:16 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac Jul 19 13:16:16 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:16 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:16 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac Jul 19 13:16:16 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:16 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-b0e50a12-b836-40d8-9634-45a2b12d2bac" returned: 0 in 0.301s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-b0e50a12-b836-40d8-9634-45a2b12d2bac" released by "delete_volume" :: held 0.725s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:16 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created reservations ['664bd588-4a3f-4740-b480-1bad602050aa', '3662f6a1-13dd-40a3-88e6-f1597c2833e8', '4aceb672-41fb-4bea-9380-a946269ff91d', '2170a30c-2cbe-42a0-9fbd-a56df02d5845'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:17 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:17 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:17 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.265s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-9dcee607-04b0-42d4-a0b4-3fcf67deb121-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Deleted volume successfully. Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-9dcee607-04b0-42d4-a0b4-3fcf67deb121-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a61534fe-7b47-4a90-a81d-083294213775 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-b0e50a12-b836-40d8-9634-45a2b12d2bac-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-quobyte-9dcee607-04b0-42d4-a0b4-3fcf67deb121" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-9dcee607-04b0-42d4-a0b4-3fcf67deb121" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24750948-b5fb-4f48-b52d-65b8bd77042e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:17 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 Jul 19 13:16:17 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:17 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" returned: 0 in 1.761s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97bba3f0-2950-4456-be46-6a90be277718_nm7qrejqdevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:16:17 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Converted 112.00 MB image at 63.57 MB/s Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:17 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 1G Jul 19 13:16:17 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:17 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121" returned: 0 in 0.363s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:17 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121 Jul 19 13:16:17 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:18 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 1G" returned: 0 in 0.318s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Downloaded image 97bba3f0-2950-4456-be46-6a90be277718 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}])) to volume 898af1b8-fe30-4820-ab91-c9f4a0bd88a6 successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:16:18 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Temporary image 97bba3f0-2950-4456-be46-6a90be277718 for user 63d9f6de00144decac8df9846ae65516 is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Marking volume 898af1b8-fe30-4820-ab91-c9f4a0bd88a6 as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9dcee607-04b0-42d4-a0b4-3fcf67deb121" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-9dcee607-04b0-42d4-a0b4-3fcf67deb121" released by "delete_volume" :: held 0.669s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Copying metadata from image 97bba3f0-2950-4456-be46-6a90be277718 to 898af1b8-fe30-4820-ab91-c9f4a0bd88a6. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Creating volume glance metadata for volume 898af1b8-fe30-4820-ab91-c9f4a0bd88a6 backed by image 97bba3f0-2950-4456-be46-6a90be277718 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created reservations ['5c8b1f3c-e1e4-4593-a1cb-d7e8cd74f812', '383a097c-8773-4c4d-84c5-ef9c40c8efc0', '16cc95f1-66f9-4a92-ad67-12c8ddd55a88', 'e0c8b4e5-a27c-4c75-960e-a1e02ed67419'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67981af4-886c-4556-824b-7533dce4ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6', 'volume_size': 1, 'image_id': '97bba3f0-2950-4456-be46-6a90be277718', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bba3f0-2950-4456-be46-6a90be277718', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bea911a85004966bff4488b454778f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97bba3f0-2950-4456-be46-6a90be277718', 'created_at': datetime.datetime(2026, 7, 19, 10, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 10, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bba3f0-2950-4456-be46-6a90be277718/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d8a43b-8630-4667-85ba-ff98020d5d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Volume volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 (898af1b8-fe30-4820-ab91-c9f4a0bd88a6): created successfully Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d8a43b-8630-4667-85ba-ff98020d5d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Flow 'volume_create_manager' (64ad22d4-c9b6-44ce-820f-93acc30ac82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-736db31f-fe68-4b01-89d0-0678d5a3758d tempest-VolumesExtendTest-1620078875 None] Created volume successfully. Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:18 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:18 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:18 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-5bb6b5fc-3a92-4227-956a-4b74a615fa79-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Deleted volume successfully. Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-5bb6b5fc-3a92-4227-956a-4b74a615fa79-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0a2f058c-a693-4f03-95f6-aa72af54c595 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-9dcee607-04b0-42d4-a0b4-3fcf67deb121-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-quobyte-5bb6b5fc-3a92-4227-956a-4b74a615fa79" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-5bb6b5fc-3a92-4227-956a-4b74a615fa79" acquired by "delete_volume" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e707d2-6fb6-48ff-b465-98506ad608fb]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:18 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 Jul 19 13:16:18 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb1f4c-2363-4691-af7e-8085cd57b517]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:18 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 Jul 19 13:16:18 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:19 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:19 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79 Jul 19 13:16:19 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:19 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 2G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 2G" returned: 0 in 0.099s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.507s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:19 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bb6b5fc-3a92-4227-956a-4b74a615fa79" returned: 0 in 0.287s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-5bb6b5fc-3a92-4227-956a-4b74a615fa79" released by "delete_volume" :: held 0.715s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:19 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4b979fc2-6041-4bb8-9647-1a88743d9baa tempest-VolumesExtendTest-1620078875 None] Extend volume completed successfully. Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created reservations ['76b11f4f-b664-4822-bf09-c487ae617cfa', 'ce055144-2e33-4aa0-bfb3-d0b4e89c1bfe', '4ff9b53d-3deb-4b0f-b13b-03ed350faaf2', 'ff4a5c0e-ea51-4249-9602-bdab0a91e2d7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:19 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:19 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-c029ba7d-e17f-481c-af57-9b6e20a2317f-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:19 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.259s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:19 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Deleted volume successfully. Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-c029ba7d-e17f-481c-af57-9b6e20a2317f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e890939e-77ce-43b6-a497-d9a01f36b113 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-5bb6b5fc-3a92-4227-956a-4b74a615fa79-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-quobyte-c029ba7d-e17f-481c-af57-9b6e20a2317f" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-c029ba7d-e17f-481c-af57-9b6e20a2317f" acquired by "delete_volume" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e6a70-cca6-4040-899e-b6b44e625e78]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:19 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f Jul 19 13:16:19 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "cinder-898af1b8-fe30-4820-ab91-c9f4a0bd88a6-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-898af1b8-fe30-4820-ab91-c9f4a0bd88a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "cinder-quobyte-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec057ec6-eab5-49a2-a635-f735ebddd54b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:20 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f" returned: 0 in 0.407s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:20 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f Jul 19 13:16:20 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:20 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 Jul 19 13:16:20 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:20 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c029ba7d-e17f-481c-af57-9b6e20a2317f" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-c029ba7d-e17f-481c-af57-9b6e20a2317f" released by "delete_volume" :: held 0.710s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:20 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created reservations ['1129c962-9311-4650-8d58-feb6dffe30c5', '2edd050d-6d25-455b-b415-a4200b488315', 'f7de79ab-89b1-456d-bcbb-f5da628fdd99', '32ad01dd-178e-41d3-b11b-1018aecaf836'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:20 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6 Jul 19 13:16:20 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:20 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:20 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:20 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-898af1b8-fe30-4820-ab91-c9f4a0bd88a6" released by "delete_volume" :: held 0.666s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Created reservations ['25ba2940-fbd9-471d-b0d2-84cf0979c833', '2adfa61b-3458-4467-9783-98685cbdbaa0', '8f4a47ec-9674-4be9-be9f-1f10161385d3', 'ed7eba82-7c58-4441-bb4c-21d6e30aa6c1'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:20 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-a22edf48-918c-4c91-806c-79cd764aaefa-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.282s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Deleted volume successfully. Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-a22edf48-918c-4c91-806c-79cd764aaefa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5445363b-01cf-4df3-ba10-17ac961d5001 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-c029ba7d-e17f-481c-af57-9b6e20a2317f-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "cinder-quobyte-a22edf48-918c-4c91-806c-79cd764aaefa" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:21 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-a22edf48-918c-4c91-806c-79cd764aaefa" acquired by "delete_volume" :: waited 0.041s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:21 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[949790d8-13a0-496d-9244-d72e95954015]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:21 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa Jul 19 13:16:21 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:21 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Deleted volume successfully. Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8f6651a9-0f5a-4235-bbb6-a8f2651eedb6 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-898af1b8-fe30-4820-ab91-c9f4a0bd88a6-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:21 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa" returned: 0 in 0.397s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:21 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa Jul 19 13:16:21 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Flow 'volume_create_manager' (f299e4f0-848c-480a-8528-95e5d3f6d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f044cae9-565a-4e0d-8629-2305c3c2a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:21 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f044cae9-565a-4e0d-8629-2305c3c2a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-10300726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420984f2-7547-4d8f-8adf-dd68ec9389ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647060144a3f498eb75de92daa609b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:22Z,use_quota=True,user_id='63d9f6de00144decac8df9846ae65516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d7f4ba-27ad-4b2d-a6f0-a643e8ac7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d7f4ba-27ad-4b2d-a6f0-a643e8ac7218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19afd960-2a2c-46f8-8f50-8c59327c0226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19afd960-2a2c-46f8-8f50-8c59327c0226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420984f2-7547-4d8f-8adf-dd68ec9389ee', 'volume_name': 'volume-420984f2-7547-4d8f-8adf-dd68ec9389ee', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fbad16-9f0b-467d-83ce-1e5887f6a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fbad16-9f0b-467d-83ce-1e5887f6a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fabbb9c-6e4e-49d6-860d-3431ad631bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:21 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Volume 420984f2-7547-4d8f-8adf-dd68ec9389ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420984f2-7547-4d8f-8adf-dd68ec9389ee', 'volume_size': 1} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-10300726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420984f2-7547-4d8f-8adf-dd68ec9389ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647060144a3f498eb75de92daa609b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:22Z,use_quota=True,user_id='63d9f6de00144decac8df9846ae65516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Creating volume 420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:21 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a22edf48-918c-4c91-806c-79cd764aaefa" returned: 0 in 0.316s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-quobyte-a22edf48-918c-4c91-806c-79cd764aaefa" released by "delete_volume" :: held 0.765s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:21 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee 1073741824 Jul 19 13:16:21 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Created reservations ['f13737e9-117d-4b71-b8e9-227488dfc26b', '9757f2b4-6ee6-4a6d-9a49-95f190eab046', 'f8a5dc1e-49b1-443e-9da9-b89dadb1afe0', '0f15a07d-8048-4a7d-a861-338dbc5cd57b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:21 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:21 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:22 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.247s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Deleted volume successfully. Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7643f674-78c7-44f8-b698-d92eead0cc33 tempest-CreateVolumesFromSourceVolumeTest-208730743 None] Lock "cinder-a22edf48-918c-4c91-806c-79cd764aaefa-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:22 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee 1073741824" returned: 0 in 0.469s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:22 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee Jul 19 13:16:22 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:22 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fabbb9c-6e4e-49d6-860d-3431ad631bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420984f2-7547-4d8f-8adf-dd68ec9389ee', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59f1868-2ed3-4020-af17-81f316f19f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:22 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Volume volume-420984f2-7547-4d8f-8adf-dd68ec9389ee (420984f2-7547-4d8f-8adf-dd68ec9389ee): created successfully Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59f1868-2ed3-4020-af17-81f316f19f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Flow 'volume_create_manager' (f299e4f0-848c-480a-8528-95e5d3f6d814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-70e7bd80-8942-4204-851c-705786c7307c tempest-VolumesExtendTest-1620078875 None] Created volume successfully. Jul 19 13:16:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Creating offline snapshot a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 of volume 420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:16:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb6874-088c-45d3-a7d5-9c25a3250b7a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:24 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee Jul 19 13:16:24 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:24 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee" returned: 0 in 0.378s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:24 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 1G Jul 19 13:16:24 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:24 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 1G" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420984f2-7547-4d8f-8adf-dd68ec9389ee -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:24 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420984f2-7547-4d8f-8adf-dd68ec9389ee -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 Jul 19 13:16:24 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Flow 'volume_create_manager' (be87e34c-5bec-4950-a393-31b36e2ea78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1821ce-4d20-453d-8c8c-c5a7cfc2813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1821ce-4d20-453d-8c8c-c5a7cfc2813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1143621667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b0472a-0544-4355-92b3-90ce1af2bf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526ad5582bfa4611a18a15bcb4a55bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:25Z,use_quota=True,user_id='470beaff34664f2bb3c4195f4e6182ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84699636-4c7c-46ea-979d-be22290409ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84699636-4c7c-46ea-979d-be22290409ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad017b99-3252-4d74-b60f-d918f5594f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad017b99-3252-4d74-b60f-d918f5594f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b0472a-0544-4355-92b3-90ce1af2bf64', 'volume_name': 'volume-f5b0472a-0544-4355-92b3-90ce1af2bf64', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf0bddb-91f6-41e2-8d43-b58a0a2e3d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf0bddb-91f6-41e2-8d43-b58a0a2e3d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55affef1-1b8a-48b5-962c-a21fe6ef7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:24 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Volume f5b0472a-0544-4355-92b3-90ce1af2bf64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b0472a-0544-4355-92b3-90ce1af2bf64', 'volume_size': 1} Jul 19 13:16:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:25 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420984f2-7547-4d8f-8adf-dd68ec9389ee -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" returned: 0 in 0.288s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:25 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 is being set with open permissions: ugo+rw Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:25 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 Jul 19 13:16:25 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:25 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" returned: 0 in 0.234s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:25 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.info Jul 19 13:16:25 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:25 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.info" returned: 0 in 0.247s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:25 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.info is being set with open permissions: ugo+rw Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:25 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.info Jul 19 13:16:25 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:25 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.info" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1143621667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b0472a-0544-4355-92b3-90ce1af2bf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526ad5582bfa4611a18a15bcb4a55bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:25Z,use_quota=True,user_id='470beaff34664f2bb3c4195f4e6182ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Creating volume f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:25 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:25 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 1073741824 Jul 19 13:16:25 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cea21f5c-5073-4bd7-8033-97ef9db4ab38 tempest-VolumesExtendTest-1620078875 None] Create snapshot completed successfully Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:26 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 1073741824" returned: 0 in 0.430s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:26 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 Jul 19 13:16:26 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:26 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.416s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55affef1-1b8a-48b5-962c-a21fe6ef7912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b0472a-0544-4355-92b3-90ce1af2bf64', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcb111a-dc39-4dfb-b0b3-73ee94762013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a428c7-ef1b-41f5-9449-ca8f76e71144]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:26 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Volume volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 (f5b0472a-0544-4355-92b3-90ce1af2bf64): created successfully Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcb111a-dc39-4dfb-b0b3-73ee94762013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Flow 'volume_create_manager' (be87e34c-5bec-4950-a393-31b36e2ea78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-36e1766a-c113-4ef8-b463-158d507655cf tempest-VolumeDependencyTests-142712754 None] Created volume successfully. Jul 19 13:16:26 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee Jul 19 13:16:26 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:26 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee" returned: 0 in 0.374s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 2G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 2G" returned: 0 in 0.145s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.566s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.058s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Creating offline snapshot d6734c38-052c-4243-89c8-b3adc0a98350 of volume f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[98441968-a6b5-4995-9184-e69173a28e20]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:27 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0b264ffe-c02a-4cb4-892d-79af12d01f69 tempest-VolumesExtendTest-1620078875 None] Extend volume completed successfully. Jul 19 13:16:27 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 Jul 19 13:16:27 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Acquiring lock "cinder-a9f3a6cb-2d50-4f3f-a204-2b1d551c5295-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Lock "cinder-a9f3a6cb-2d50-4f3f-a204-2b1d551c5295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Acquiring lock "cinder-quobyte-420984f2-7547-4d8f-8adf-dd68ec9389ee" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-420984f2-7547-4d8f-8adf-dd68ec9389ee" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Acquiring lock "cinder-quobyte-a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Deleting offline snapshot a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 of volume 420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] snapshot_file for this snap is: volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0981b7-4778-4df8-845e-dacc42de78cc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:27 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64" returned: 0 in 0.363s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:27 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 1G Jul 19 13:16:27 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:27 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 Jul 19 13:16:27 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:27 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420984f2-7547-4d8f-8adf-dd68ec9389ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[52853f2b-dd2d-4ee3-977b-c1ccae2cedd2]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:27 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 1G" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:27 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 Jul 19 13:16:27 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:27 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee Jul 19 13:16:27 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:28 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:28 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee" returned: 0 in 0.367s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350" returned: 0 in 0.304s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:28 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 is being set with open permissions: ugo+rw Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:28 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 Jul 19 13:16:28 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:28 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 Jul 19 13:16:28 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:28 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:28 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.info Jul 19 13:16:28 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:28 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" returned: 0 in 0.369s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:28 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295 Jul 19 13:16:28 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:28 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.info" returned: 0 in 0.250s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:28 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.info is being set with open permissions: ugo+rw Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:28 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.info Jul 19 13:16:28 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:28 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee.a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" returned: 0 in 0.246s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-a9f3a6cb-2d50-4f3f-a204-2b1d551c5295" released by "_delete_snapshot" :: held 1.470s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-420984f2-7547-4d8f-8adf-dd68ec9389ee" released by "delete_snapshot" :: held 1.496s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Created reservations ['bd2f343c-adda-40f2-a572-ef1b9886a11b', 'dcbfdb76-0a6a-4b54-a7c0-50a3b58f4b4e', '7098336f-8138-4ff4-8185-34aa153565c8', '7a703b8d-8cbb-4cfd-8760-36864e9dc39e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:28 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Delete snapshot completed successfully. Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1fe44a9e-9d3b-4518-9aae-470736cedd2b tempest-VolumesExtendTest-1620078875 None] Lock "cinder-a9f3a6cb-2d50-4f3f-a204-2b1d551c5295-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:28 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.info" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4b95b751-4af1-46df-9f7b-450b5368aa4a tempest-VolumeDependencyTests-142712754 None] Create snapshot completed successfully Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "cinder-420984f2-7547-4d8f-8adf-dd68ec9389ee-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-420984f2-7547-4d8f-8adf-dd68ec9389ee-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "cinder-quobyte-420984f2-7547-4d8f-8adf-dd68ec9389ee" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-420984f2-7547-4d8f-8adf-dd68ec9389ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4087e3d3-e329-4fb3-93e8-3c5a5fbe6ef1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Flow 'volume_create_manager' (a66c889a-edaa-48f7-9edd-0d6c91e498bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270a5b4c-f4dc-4443-86fa-e67dc0ab1897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270a5b4c-f4dc-4443-86fa-e67dc0ab1897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1276660574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b218f04-1cda-4ca3-b73a-16c6fd03d3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526ad5582bfa4611a18a15bcb4a55bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6734c38-052c-4243-89c8-b3adc0a98350,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:30Z,use_quota=True,user_id='470beaff34664f2bb3c4195f4e6182ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec5bf7-9af6-41ee-af1f-9730b913726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec5bf7-9af6-41ee-af1f-9730b913726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8e557b-23e0-4917-8141-adcc57db2f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:29 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee Jul 19 13:16:29 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8e557b-23e0-4917-8141-adcc57db2f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b218f04-1cda-4ca3-b73a-16c6fd03d3dc', 'volume_name': 'volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc', 'volume_size': 1, 'snapshot_id': 'd6734c38-052c-4243-89c8-b3adc0a98350'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e073bbb4-989a-4074-af16-daaa19a6bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e073bbb4-989a-4074-af16-daaa19a6bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4a8113-104e-4865-ada3-4ee94070d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:29 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Volume 8b218f04-1cda-4ca3-b73a-16c6fd03d3dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc', 'volume_size': 1, 'snapshot_id': 'd6734c38-052c-4243-89c8-b3adc0a98350'} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-quobyte-d6734c38-052c-4243-89c8-b3adc0a98350-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-d6734c38-052c-4243-89c8-b3adc0a98350-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Creating volume 8b218f04-1cda-4ca3-b73a-16c6fd03d3dc from snapshot d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-quobyte-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] snapshot: d6734c38-052c-4243-89c8-b3adc0a98350, volume: 8b218f04-1cda-4ca3-b73a-16c6fd03d3dc, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4541461e-f911-4cb1-a320-ef76c71ba4c8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:29 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 Jul 19 13:16:29 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:30 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:30 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee Jul 19 13:16:30 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:30 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350" returned: 0 in 0.372s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5b0472a-0544-4355-92b3-90ce1af2bf64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7738d0c0-ce76-4fcf-97f6-24e3d25b638e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:30 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-420984f2-7547-4d8f-8adf-dd68ec9389ee" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-quobyte-420984f2-7547-4d8f-8adf-dd68ec9389ee" released by "delete_volume" :: held 0.695s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Created reservations ['2f6c772e-7514-4c11-bc62-a8d92890bc17', 'de8c7964-0081-41f9-9c5f-3a84ffd57217', '115193a2-d2d5-4516-ad7d-3661e8cc3c9f', '9569d9cd-136b-45bb-ac35-7363b8f8f370'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:30 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 Jul 19 13:16:30 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:30 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:30 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:30 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64" returned: 0 in 0.374s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:30 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.258s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Deleted volume successfully. Jul 19 13:16:30 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc Jul 19 13:16:30 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:30 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-289b7189-0d69-49e0-b7fb-f82ceb32f193 tempest-VolumesExtendTest-1620078875 None] Lock "cinder-420984f2-7547-4d8f-8adf-dd68ec9389ee-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:35 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" returned: 0 in 4.780s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d496107c-0188-4a8c-99b4-37ac91138418]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:35 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 Jul 19 13:16:35 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:35 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64" returned: 0 in 0.543s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:35 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:16:35 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Converted 1024.00 MB image at 214.19 MB/s Jul 19 13:16:35 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc is being set with open permissions: ugo+rw Jul 19 13:16:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:36 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc Jul 19 13:16:36 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:36 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" returned: 0 in 0.259s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" released by "_copy_volume_from_snapshot" :: held 6.419s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-d6734c38-052c-4243-89c8-b3adc0a98350-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" released by "_create_volume_from_snapshot" :: held 6.453s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.476s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4a8113-104e-4865-ada3-4ee94070d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc', 'volume_size': 1, 'snapshot_id': 'd6734c38-052c-4243-89c8-b3adc0a98350'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361e83cf-27d5-461a-8fa8-7d0a607b8209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:36 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Volume volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc (8b218f04-1cda-4ca3-b73a-16c6fd03d3dc): created successfully Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361e83cf-27d5-461a-8fa8-7d0a607b8209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Flow 'volume_create_manager' (a66c889a-edaa-48f7-9edd-0d6c91e498bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0b2ed081-6b5d-45f8-9d3d-c419b882b9cf tempest-VolumeDependencyTests-142712754 None] Created volume successfully. Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-d6734c38-052c-4243-89c8-b3adc0a98350-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Lock "cinder-d6734c38-052c-4243-89c8-b3adc0a98350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-quobyte-f5b0472a-0544-4355-92b3-90ce1af2bf64" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-f5b0472a-0544-4355-92b3-90ce1af2bf64" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-quobyte-d6734c38-052c-4243-89c8-b3adc0a98350" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-d6734c38-052c-4243-89c8-b3adc0a98350" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Deleting offline snapshot d6734c38-052c-4243-89c8-b3adc0a98350 of volume f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] snapshot_file for this snap is: volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e2121-2855-4457-ac56-e01ed377231d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:37 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 Jul 19 13:16:37 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:38 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350" returned: 0 in 0.381s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5b0472a-0544-4355-92b3-90ce1af2bf64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dfe4dd-88d1-44e8-b49a-bd6f9dd5a3cb]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:38 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 Jul 19 13:16:38 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:38 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64" returned: 0 in 0.360s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:38 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 Jul 19 13:16:38 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:38 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350" returned: 0 in 0.389s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:38 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350 Jul 19 13:16:38 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:39 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64.d6734c38-052c-4243-89c8-b3adc0a98350" returned: 0 in 0.248s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-d6734c38-052c-4243-89c8-b3adc0a98350" released by "_delete_snapshot" :: held 1.489s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-f5b0472a-0544-4355-92b3-90ce1af2bf64" released by "delete_snapshot" :: held 1.509s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Created reservations ['b90f7acb-4f29-4a12-b715-1ca52cf35c88', 'a287dadd-09f9-46c1-8acc-96e9cf064e1a', '98abaf14-5365-49fd-855f-52c04ad98509', 'a0952c96-85e2-4760-9320-45d7c59fb565'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:39 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Delete snapshot completed successfully. Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d0470431-9224-4c2a-87c7-e70c54f84d80 tempest-VolumeDependencyTests-142712754 None] Lock "cinder-d6734c38-052c-4243-89c8-b3adc0a98350-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-f5b0472a-0544-4355-92b3-90ce1af2bf64-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-f5b0472a-0544-4355-92b3-90ce1af2bf64-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-quobyte-f5b0472a-0544-4355-92b3-90ce1af2bf64" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-f5b0472a-0544-4355-92b3-90ce1af2bf64" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b3fc93-67d2-440f-af16-5be04476208a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:39 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 Jul 19 13:16:39 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:40 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64" returned: 0 in 0.376s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:40 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64 Jul 19 13:16:40 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:40 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f5b0472a-0544-4355-92b3-90ce1af2bf64" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-f5b0472a-0544-4355-92b3-90ce1af2bf64" released by "delete_volume" :: held 0.706s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Created reservations ['6b03f3c9-bcb6-4def-8df8-01a7c671142a', '453e2903-267f-4c98-b81c-2d78aed95f15', '1cbef62d-4580-43d2-96ea-65b8bf581d23', 'cec94a96-387f-4c8e-8270-760b54cc92cb'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:40 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:40 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Acquiring lock "cinder-quobyte-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:40 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.287s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Deleted volume successfully. Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5bff68-1f99-4825-8621-5ba4e261d85e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1c3d75f4-49bb-473a-83f1-96807ac8362f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-f5b0472a-0544-4355-92b3-90ce1af2bf64-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:41 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc Jul 19 13:16:41 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:41 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:41 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc Jul 19 13:16:41 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:41 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-quobyte-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc" released by "delete_volume" :: held 0.744s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Created reservations ['6aa173e4-8707-451b-9052-e1dbb28c412e', 'b41b1751-ea9f-45cc-9ad3-bcb1934b112a', '02665bf8-4aae-4867-a54b-3940d5d6db8a', '14d95495-adaa-4ca8-b1a4-218b486d5255'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:41 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:41 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:42 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:42 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Deleted volume successfully. Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-29bb388c-f451-4164-b419-ca1d0c479d1f tempest-VolumeDependencyTests-142712754 None] Lock "cinder-8b218f04-1cda-4ca3-b73a-16c6fd03d3dc-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:42 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:42 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:42 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.269s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:16:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Flow 'volume_create_manager' (b6ad00ee-6bd9-432d-adf5-a3026aca705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a814e28b-2174-47c9-9bd3-c1ca8bef7418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a814e28b-2174-47c9-9bd3-c1ca8bef7418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264348684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f84adf-2ab5-41d4-8893-500b19e6e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8257832e2554d5087709933989149f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:46Z,use_quota=True,user_id='a94b62c675fb41f282695d50a6a90f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a8585e-a3c6-4873-b1da-4e97a2ac7207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a8585e-a3c6-4873-b1da-4e97a2ac7207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1208f897-6e38-4b91-b9cb-20b00a50ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1208f897-6e38-4b91-b9cb-20b00a50ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f84adf-2ab5-41d4-8893-500b19e6e952', 'volume_name': 'volume-a7f84adf-2ab5-41d4-8893-500b19e6e952', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9970dd9f-aebb-4f77-bb39-06201289310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9970dd9f-aebb-4f77-bb39-06201289310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b307e6-ffe8-46e8-9611-a7e7bcd06f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:46 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Volume a7f84adf-2ab5-41d4-8893-500b19e6e952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f84adf-2ab5-41d4-8893-500b19e6e952', 'volume_size': 1} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264348684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f84adf-2ab5-41d4-8893-500b19e6e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8257832e2554d5087709933989149f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:46Z,use_quota=True,user_id='a94b62c675fb41f282695d50a6a90f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Creating volume a7f84adf-2ab5-41d4-8893-500b19e6e952 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:46 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:46 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 1073741824 Jul 19 13:16:46 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:46 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 1073741824" returned: 0 in 0.482s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:46 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 Jul 19 13:16:46 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:47 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b307e6-ffe8-46e8-9611-a7e7bcd06f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f84adf-2ab5-41d4-8893-500b19e6e952', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a38425-07d1-49d9-ad59-3ea0fd78be0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:47 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Volume volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 (a7f84adf-2ab5-41d4-8893-500b19e6e952): created successfully Jul 19 13:16:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a38425-07d1-49d9-ad59-3ea0fd78be0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Flow 'volume_create_manager' (b6ad00ee-6bd9-432d-adf5-a3026aca705d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2a36ebc2-dfa6-49b3-b59b-8a4cb9722ad6 tempest-ProjectReaderTests-1397101686 None] Created volume successfully. Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "cinder-a7f84adf-2ab5-41d4-8893-500b19e6e952-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-a7f84adf-2ab5-41d4-8893-500b19e6e952-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "cinder-quobyte-a7f84adf-2ab5-41d4-8893-500b19e6e952" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-quobyte-a7f84adf-2ab5-41d4-8893-500b19e6e952" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2988b5-d1f2-4195-aaca-3b9c512414f8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:48 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 Jul 19 13:16:48 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:48 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952" returned: 0 in 0.364s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:48 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952 Jul 19 13:16:48 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:49 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a7f84adf-2ab5-41d4-8893-500b19e6e952" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-quobyte-a7f84adf-2ab5-41d4-8893-500b19e6e952" released by "delete_volume" :: held 0.658s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Created reservations ['ed385240-0a3d-44a3-bc97-d4d3703e912e', 'cb7e26a3-071f-4c6f-8a58-6e486ffd85c4', 'b5555e0f-853b-47f2-adf1-a18d14103b11', '09069402-ee6d-40ad-985f-63cdf67dba00'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:49 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:49 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:49 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:49 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Deleted volume successfully. Jul 19 13:16:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-08bd7dcb-b84f-4c30-b1c0-4cd5ea03ba57 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-a7f84adf-2ab5-41d4-8893-500b19e6e952-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Flow 'volume_create_manager' (0e17f7be-1efb-48aa-8627-10ae7cb23ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b12a91d-fc1e-49d6-b419-ebec29385d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b12a91d-fc1e-49d6-b419-ebec29385d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028775674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a6699-10d5-40ff-bb98-5b27d85cd5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8257832e2554d5087709933989149f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:50Z,use_quota=True,user_id='a94b62c675fb41f282695d50a6a90f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674c2bb1-c2af-4821-a137-339c503a7176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674c2bb1-c2af-4821-a137-339c503a7176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad41ee0-d119-4037-88a2-d0da5cfb256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad41ee0-d119-4037-88a2-d0da5cfb256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287a6699-10d5-40ff-bb98-5b27d85cd5d1', 'volume_name': 'volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78efa802-6c04-4b70-afb6-6d91540e12dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78efa802-6c04-4b70-afb6-6d91540e12dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc720211-1a2e-4a33-9e71-31b98bb8a91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:50 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Volume 287a6699-10d5-40ff-bb98-5b27d85cd5d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1', 'volume_size': 1} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028775674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a6699-10d5-40ff-bb98-5b27d85cd5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8257832e2554d5087709933989149f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:50Z,use_quota=True,user_id='a94b62c675fb41f282695d50a6a90f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Creating volume 287a6699-10d5-40ff-bb98-5b27d85cd5d1 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:50 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:50 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 1073741824 Jul 19 13:16:50 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:50 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 1073741824" returned: 0 in 0.456s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:50 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 Jul 19 13:16:50 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:51 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc720211-1a2e-4a33-9e71-31b98bb8a91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad79525-50d0-49e8-8653-7904514c3f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:51 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Volume volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 (287a6699-10d5-40ff-bb98-5b27d85cd5d1): created successfully Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad79525-50d0-49e8-8653-7904514c3f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Flow 'volume_create_manager' (0e17f7be-1efb-48aa-8627-10ae7cb23ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:51 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ee7ccfdb-3abb-41a7-b985-8b1011fcf848 tempest-ProjectReaderTests-1397101686 None] Created volume successfully. Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "cinder-287a6699-10d5-40ff-bb98-5b27d85cd5d1-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-287a6699-10d5-40ff-bb98-5b27d85cd5d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "cinder-quobyte-287a6699-10d5-40ff-bb98-5b27d85cd5d1" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-quobyte-287a6699-10d5-40ff-bb98-5b27d85cd5d1" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e01b72-fd47-4863-bd34-43255550bdbd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:51 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 Jul 19 13:16:51 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:51 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1" returned: 0 in 0.405s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:51 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1 Jul 19 13:16:51 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:52 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-287a6699-10d5-40ff-bb98-5b27d85cd5d1" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-quobyte-287a6699-10d5-40ff-bb98-5b27d85cd5d1" released by "delete_volume" :: held 0.715s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Created reservations ['b008c664-835f-4b02-bd8d-45c87cf29b3a', 'a2a49895-6aeb-4a04-bd98-562f2b9ea93d', 'd662d5bd-9df6-47d8-9cfc-05633641da6d', '737a7bfa-1754-40ea-ba95-db7b79eb3cf2'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:52 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:16:52 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:52 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.301s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:16:52 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Deleted volume successfully. Jul 19 13:16:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fe1addff-ef35-408f-8921-86892b163660 tempest-ProjectReaderTests-1397101686 None] Lock "cinder-287a6699-10d5-40ff-bb98-5b27d85cd5d1-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Flow 'volume_create_manager' (8df4aa13-47b0-4acd-85d4-6ace6207e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26d4e3-28bb-4d75-9887-273a58c722b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26d4e3-28bb-4d75-9887-273a58c722b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-977967759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed50390-d90a-4c21-b550-ed20162d4ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad9e3f3de2e408fa584712c792e7c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:56Z,use_quota=True,user_id='cfd804e08072434592bb253bb0f00567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e70317-36fa-41e8-b639-9fe99c253540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e70317-36fa-41e8-b639-9fe99c253540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875dcddd-a856-4427-81e1-36a3084355ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875dcddd-a856-4427-81e1-36a3084355ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed50390-d90a-4c21-b550-ed20162d4ae6', 'volume_name': 'volume-8ed50390-d90a-4c21-b550-ed20162d4ae6', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb29d67-1131-4077-a8d7-9445d7a15149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb29d67-1131-4077-a8d7-9445d7a15149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f7733e-bee7-4a6a-8e30-80efbd3917f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:55 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Volume 8ed50390-d90a-4c21-b550-ed20162d4ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed50390-d90a-4c21-b550-ed20162d4ae6', 'volume_size': 1} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-977967759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed50390-d90a-4c21-b550-ed20162d4ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad9e3f3de2e408fa584712c792e7c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:56Z,use_quota=True,user_id='cfd804e08072434592bb253bb0f00567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Creating volume 8ed50390-d90a-4c21-b550-ed20162d4ae6 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:55 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:55 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 1073741824 Jul 19 13:16:55 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Flow 'volume_create_manager' (601b86ee-05b0-499c-bc92-5758f2e43f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c553afe8-c48a-4345-a959-8165702cf0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c553afe8-c48a-4345-a959-8165702cf0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2119049564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dd5177-310d-4132-8082-bc493dfa262a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad9e3f3de2e408fa584712c792e7c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:56Z,use_quota=True,user_id='cfd804e08072434592bb253bb0f00567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db720e7b-fa5c-4d43-b1b5-efdbe1f42f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db720e7b-fa5c-4d43-b1b5-efdbe1f42f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144d62b8-78a8-436e-bbaf-0ae60a546833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144d62b8-78a8-436e-bbaf-0ae60a546833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90dd5177-310d-4132-8082-bc493dfa262a', 'volume_name': 'volume-90dd5177-310d-4132-8082-bc493dfa262a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f72e417-3b07-4a76-89d2-95f779aeb8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f72e417-3b07-4a76-89d2-95f779aeb8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47cbeae-4231-488f-b40a-f56330659e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:56 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Volume 90dd5177-310d-4132-8082-bc493dfa262a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90dd5177-310d-4132-8082-bc493dfa262a', 'volume_size': 1} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:56 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 1073741824" returned: 0 in 0.628s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:56 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 Jul 19 13:16:56 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:56 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6" returned: 0 in 0.293s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2119049564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dd5177-310d-4132-8082-bc493dfa262a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad9e3f3de2e408fa584712c792e7c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:16:56Z,use_quota=True,user_id='cfd804e08072434592bb253bb0f00567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Creating volume 90dd5177-310d-4132-8082-bc493dfa262a {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:16:56 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:56 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a 1073741824 Jul 19 13:16:56 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f7733e-bee7-4a6a-8e30-80efbd3917f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed50390-d90a-4c21-b550-ed20162d4ae6', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23570ea6-0eb8-49b9-b7c4-16aaedd0e91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:56 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Volume volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 (8ed50390-d90a-4c21-b550-ed20162d4ae6): created successfully Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23570ea6-0eb8-49b9-b7c4-16aaedd0e91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Flow 'volume_create_manager' (8df4aa13-47b0-4acd-85d4-6ace6207e925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:56 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c0c5b79a-1e04-49de-b11a-d7d62ea4dd1a tempest-TestServerVolumeAttachmentScenario-545311160 None] Created volume successfully. Jul 19 13:16:57 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a 1073741824" returned: 0 in 0.570s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:16:57 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a Jul 19 13:16:57 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:16:57 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a" returned: 0 in 0.265s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47cbeae-4231-488f-b40a-f56330659e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90dd5177-310d-4132-8082-bc493dfa262a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1876dd70-c040-4817-bd18-bbbfa2dd51bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:16:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Volume volume-90dd5177-310d-4132-8082-bc493dfa262a (90dd5177-310d-4132-8082-bc493dfa262a): created successfully Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1876dd70-c040-4817-bd18-bbbfa2dd51bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:16:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Flow 'volume_create_manager' (601b86ee-05b0-499c-bc92-5758f2e43f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:16:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-aa9d400c-0a1b-47c8-9e75-89511fa6e819 tempest-TestServerVolumeAttachmentScenario-545311160 None] Created volume successfully. Jul 19 13:17:07 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=119,cinder:INSERT=39,cinder:UPDATE=169,cinder:DELETE=15 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:17:07 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=127,cinder:INSERT=50,cinder:UPDATE=163,cinder:DELETE=15 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Flow 'volume_create_manager' (604a5b80-5854-4ff1-ae77-b7441b844e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81e27cb-98c7-41a4-96bf-5a2ee89c9b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81e27cb-98c7-41a4-96bf-5a2ee89c9b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1575609489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455589d0-3144-4fb9-b5ad-29da27d99751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fde4d95a924234822ed89bf152cda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:17:23Z,use_quota=True,user_id='55f34540fa96463fbd1101bd50eda43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ead08ed-5052-4a7a-a571-2c79c8306db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ead08ed-5052-4a7a-a571-2c79c8306db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5d6b55-1d61-4fd2-8602-faa8a4e10a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5d6b55-1d61-4fd2-8602-faa8a4e10a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '455589d0-3144-4fb9-b5ad-29da27d99751', 'volume_name': 'volume-455589d0-3144-4fb9-b5ad-29da27d99751', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d0c9d0-b097-4424-8b4c-73fa4075816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d0c9d0-b097-4424-8b4c-73fa4075816a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b603c3-e695-4b47-b41f-acdacb1af81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:22 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Volume 455589d0-3144-4fb9-b5ad-29da27d99751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-455589d0-3144-4fb9-b5ad-29da27d99751', 'volume_size': 1} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1575609489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455589d0-3144-4fb9-b5ad-29da27d99751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fde4d95a924234822ed89bf152cda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:17:23Z,use_quota=True,user_id='55f34540fa96463fbd1101bd50eda43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Creating volume 455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:17:22 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:17:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:22 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 1073741824 Jul 19 13:17:22 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:23 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 1073741824" returned: 0 in 0.406s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:23 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 Jul 19 13:17:23 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:23 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b603c3-e695-4b47-b41f-acdacb1af81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-455589d0-3144-4fb9-b5ad-29da27d99751', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59614b09-e21a-4668-acf6-555a24855067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:23 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Volume volume-455589d0-3144-4fb9-b5ad-29da27d99751 (455589d0-3144-4fb9-b5ad-29da27d99751): created successfully Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59614b09-e21a-4668-acf6-555a24855067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Flow 'volume_create_manager' (604a5b80-5854-4ff1-ae77-b7441b844e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:17:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3dd14d79-4b38-423c-8b42-12c1ccc7e32c tempest-SnapshotDependencyTests-1699399010 None] Created volume successfully. Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Creating offline snapshot 5ecae261-6e2a-4336-88bd-c3e479696d6c of volume 455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbe797b-e6b5-4e54-bf5a-500cd5eaa046]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:24 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 Jul 19 13:17:24 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:24 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751" returned: 0 in 0.356s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:24 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c 1G Jul 19 13:17:24 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:24 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c 1G" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455589d0-3144-4fb9-b5ad-29da27d99751 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:24 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455589d0-3144-4fb9-b5ad-29da27d99751 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c Jul 19 13:17:24 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:24 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455589d0-3144-4fb9-b5ad-29da27d99751 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c" returned: 0 in 0.297s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:24 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c is being set with open permissions: ugo+rw Jul 19 13:17:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:24 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c Jul 19 13:17:24 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:25 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c" returned: 0 in 0.250s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:25 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.info Jul 19 13:17:25 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:25 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.info" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:25 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.info is being set with open permissions: ugo+rw Jul 19 13:17:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:25 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.info Jul 19 13:17:25 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:25 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.info" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cac075e6-b81e-4e61-acca-97dea674d69a tempest-SnapshotDependencyTests-1699399010 None] Create snapshot completed successfully Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Flow 'volume_create_manager' (f8e4c009-2400-4a6e-a267-9c2ded0f3469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1da1873-0ac4-42e9-8349-c762cd403504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1da1873-0ac4-42e9-8349-c762cd403504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f4136c-c406-4a5c-bf52-17ac7caea410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fde4d95a924234822ed89bf152cda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ecae261-6e2a-4336-88bd-c3e479696d6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:17:27Z,use_quota=True,user_id='55f34540fa96463fbd1101bd50eda43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42781197-4db7-45a9-ba5f-892dd1eb1142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42781197-4db7-45a9-ba5f-892dd1eb1142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2abab2c-371f-4f1c-9a0c-bfdee102ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2abab2c-371f-4f1c-9a0c-bfdee102ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73f4136c-c406-4a5c-bf52-17ac7caea410', 'volume_name': 'volume-73f4136c-c406-4a5c-bf52-17ac7caea410', 'volume_size': 1, 'snapshot_id': '5ecae261-6e2a-4336-88bd-c3e479696d6c'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b59c02a-9340-47c4-9d3e-8885e536a50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b59c02a-9340-47c4-9d3e-8885e536a50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b509bd17-0d0e-4ea6-9e9d-7f141f346aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:26 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Volume 73f4136c-c406-4a5c-bf52-17ac7caea410: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73f4136c-c406-4a5c-bf52-17ac7caea410', 'volume_size': 1, 'snapshot_id': '5ecae261-6e2a-4336-88bd-c3e479696d6c'} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-quobyte-5ecae261-6e2a-4336-88bd-c3e479696d6c-73f4136c-c406-4a5c-bf52-17ac7caea410" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-5ecae261-6e2a-4336-88bd-c3e479696d6c-73f4136c-c406-4a5c-bf52-17ac7caea410" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Creating volume 73f4136c-c406-4a5c-bf52-17ac7caea410 from snapshot 5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-quobyte-73f4136c-c406-4a5c-bf52-17ac7caea410" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-73f4136c-c406-4a5c-bf52-17ac7caea410" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] snapshot: 5ecae261-6e2a-4336-88bd-c3e479696d6c, volume: 73f4136c-c406-4a5c-bf52-17ac7caea410, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0078cc46-cc9b-452f-a2d2-95b428e6a0d1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:26 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c Jul 19 13:17:26 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:27 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c" returned: 0 in 0.355s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-455589d0-3144-4fb9-b5ad-29da27d99751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca2f22b-4849-4b53-9922-a00610d2c89e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:27 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 Jul 19 13:17:27 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:27 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751" returned: 0 in 0.366s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:17:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:27 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 Jul 19 13:17:27 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-47242e34-8be8-4b63-a67d-0debea3e3f7a req-91ae7095-f6ac-44cf-89db-14dab8261c4c tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:32 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410" returned: 0 in 4.639s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfba8d-55e4-4a92-8d21-2a6f7bdf065f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:32 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 Jul 19 13:17:32 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:32 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751" returned: 0 in 0.536s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:17:32 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Converted 1024.00 MB image at 220.65 MB/s Jul 19 13:17:32 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 is being set with open permissions: ugo+rw Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:32 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 Jul 19 13:17:32 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:32 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410" returned: 0 in 0.233s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-73f4136c-c406-4a5c-bf52-17ac7caea410" released by "_copy_volume_from_snapshot" :: held 6.217s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-5ecae261-6e2a-4336-88bd-c3e479696d6c-73f4136c-c406-4a5c-bf52-17ac7caea410" released by "_create_volume_from_snapshot" :: held 6.245s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.259s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-47242e34-8be8-4b63-a67d-0debea3e3f7a req-91ae7095-f6ac-44cf-89db-14dab8261c4c tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.628s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-47242e34-8be8-4b63-a67d-0debea3e3f7a req-91ae7095-f6ac-44cf-89db-14dab8261c4c tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b509bd17-0d0e-4ea6-9e9d-7f141f346aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f4136c-c406-4a5c-bf52-17ac7caea410', 'volume_size': 1, 'snapshot_id': '5ecae261-6e2a-4336-88bd-c3e479696d6c'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9996fdf-7032-41e3-b716-36069388c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:17:32 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Volume volume-73f4136c-c406-4a5c-bf52-17ac7caea410 (73f4136c-c406-4a5c-bf52-17ac7caea410): created successfully Jul 19 13:17:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9996fdf-7032-41e3-b716-36069388c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Flow 'volume_create_manager' (f8e4c009-2400-4a6e-a267-9c2ded0f3469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-47242e34-8be8-4b63-a67d-0debea3e3f7a req-91ae7095-f6ac-44cf-89db-14dab8261c4c tempest-TestServerVolumeAttachmentScenario-545311160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-8ed50390-d90a-4c21-b550-ed20162d4ae6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bf0da80-fd02-4720-b964-548a4d3933d0', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:17:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5be808c9-12f0-4bff-afa7-9ed0a892caf8 tempest-SnapshotDependencyTests-1699399010 None] Created volume successfully. Jul 19 13:17:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-47242e34-8be8-4b63-a67d-0debea3e3f7a req-91ae7095-f6ac-44cf-89db-14dab8261c4c tempest-TestServerVolumeAttachmentScenario-545311160 None] attachment_update completed successfully. Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-5ecae261-6e2a-4336-88bd-c3e479696d6c-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-5ecae261-6e2a-4336-88bd-c3e479696d6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-quobyte-455589d0-3144-4fb9-b5ad-29da27d99751" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-455589d0-3144-4fb9-b5ad-29da27d99751" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-quobyte-5ecae261-6e2a-4336-88bd-c3e479696d6c" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-5ecae261-6e2a-4336-88bd-c3e479696d6c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Deleting offline snapshot 5ecae261-6e2a-4336-88bd-c3e479696d6c of volume 455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] snapshot_file for this snap is: volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3132963-bfb1-42a4-ad1f-debf45e78b52]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:33 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c Jul 19 13:17:33 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:33 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c" returned: 0 in 0.388s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-455589d0-3144-4fb9-b5ad-29da27d99751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d227bc9b-6cdf-49a8-8cf6-1af0692e6d11]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:33 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 Jul 19 13:17:33 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:34 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751" returned: 0 in 0.370s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:34 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c Jul 19 13:17:34 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:34 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c" returned: 0 in 0.362s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:34 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c Jul 19 13:17:34 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:34 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751.5ecae261-6e2a-4336-88bd-c3e479696d6c" returned: 0 in 0.252s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-5ecae261-6e2a-4336-88bd-c3e479696d6c" released by "_delete_snapshot" :: held 1.475s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-455589d0-3144-4fb9-b5ad-29da27d99751" released by "delete_snapshot" :: held 1.504s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Created reservations ['650a9d13-f15e-4c09-b507-c90d5191ff94', '86575b87-1127-4a76-95f1-c8757ac524ba', '5e13bcf5-ee3e-4b73-a4d6-a68a5a0c3393', '0bd1984d-af47-4cbd-b9f1-a96974d7b91d'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:17:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Delete snapshot completed successfully. Jul 19 13:17:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5d27d404-5c62-4712-be8a-9c017cfd4429 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-5ecae261-6e2a-4336-88bd-c3e479696d6c-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-455589d0-3144-4fb9-b5ad-29da27d99751-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-455589d0-3144-4fb9-b5ad-29da27d99751-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-quobyte-455589d0-3144-4fb9-b5ad-29da27d99751" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-455589d0-3144-4fb9-b5ad-29da27d99751" acquired by "delete_volume" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d71d0ee-a121-4a98-9b7c-61b22d5ca692]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:35 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 Jul 19 13:17:35 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:35 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751" returned: 0 in 0.389s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:35 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751 Jul 19 13:17:35 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:36 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-455589d0-3144-4fb9-b5ad-29da27d99751" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-455589d0-3144-4fb9-b5ad-29da27d99751" released by "delete_volume" :: held 0.729s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Created reservations ['e1d154bd-8a15-4b6e-9fb4-b1c0c3d30aec', 'c955c7d6-852d-4562-aa3d-eacf5e94fb69', 'b36e9c08-570e-4b21-9c37-c6431463112c', '1bf91ac0-6072-4d30-9ef9-a8b385f277bb'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:36 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:17:36 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-73f4136c-c406-4a5c-bf52-17ac7caea410-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-73f4136c-c406-4a5c-bf52-17ac7caea410-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:36 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.289s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:17:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Deleted volume successfully. Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "cinder-quobyte-73f4136c-c406-4a5c-bf52-17ac7caea410" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-66392a8b-1f6e-4c4e-bdec-3c744685b350 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-455589d0-3144-4fb9-b5ad-29da27d99751-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-73f4136c-c406-4a5c-bf52-17ac7caea410" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[db962b86-3660-4b87-9381-dfe207c9b6f6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-7e6bfe9d-5238-4ed9-a142-97bba7275db9 req-200fef57-cda1-4cf1-8934-09db6bb7b06e tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-7e6bfe9d-5238-4ed9-a142-97bba7275db9 req-200fef57-cda1-4cf1-8934-09db6bb7b06e tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-7e6bfe9d-5238-4ed9-a142-97bba7275db9 req-200fef57-cda1-4cf1-8934-09db6bb7b06e tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-7e6bfe9d-5238-4ed9-a142-97bba7275db9 req-200fef57-cda1-4cf1-8934-09db6bb7b06e tempest-TestServerVolumeAttachmentScenario-545311160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-90dd5177-310d-4132-8082-bc493dfa262a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5623cb12-8fa2-4385-a9ad-f51d1021bc27', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:17:36 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 Jul 19 13:17:36 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-7e6bfe9d-5238-4ed9-a142-97bba7275db9 req-200fef57-cda1-4cf1-8934-09db6bb7b06e tempest-TestServerVolumeAttachmentScenario-545311160 None] attachment_update completed successfully. Jul 19 13:17:37 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:37 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410 Jul 19 13:17:37 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:37 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-73f4136c-c406-4a5c-bf52-17ac7caea410" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-quobyte-73f4136c-c406-4a5c-bf52-17ac7caea410" released by "delete_volume" :: held 0.696s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Created reservations ['daf25bab-99de-46be-8d4a-edafd1ae5711', 'd49b3dda-e0f9-4334-8f7f-2809f02fe9be', '0e062ca3-4c94-40a7-b171-65031385aac6', '708513ea-f801-4466-ac0e-070083769887'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:37 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:17:37 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:37 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:17:37 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Deleted volume successfully. Jul 19 13:17:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-30cb168b-9599-4928-8054-1add7fe670e8 tempest-SnapshotDependencyTests-1699399010 None] Lock "cinder-73f4136c-c406-4a5c-bf52-17ac7caea410-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-a8ca0323-3b9b-40e2-b314-da5d5f863883 req-48ec4c6b-8a4e-4a7a-97b6-df462c0bcb35 tempest-TestServerVolumeAttachmentScenario-545311160 None] Terminate volume connection completed successfully. Jul 19 13:17:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-a8ca0323-3b9b-40e2-b314-da5d5f863883 req-48ec4c6b-8a4e-4a7a-97b6-df462c0bcb35 tempest-TestServerVolumeAttachmentScenario-545311160 None] Deleting attachment 5623cb12-8fa2-4385-a9ad-f51d1021bc27. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:17:39 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-ea769b44-189d-4552-9107-9f3d146c115e req-226f7438-0695-40a8-bf0f-43bf84f0d932 tempest-TestServerVolumeAttachmentScenario-545311160 None] Terminate volume connection completed successfully. Jul 19 13:17:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-ea769b44-189d-4552-9107-9f3d146c115e req-226f7438-0695-40a8-bf0f-43bf84f0d932 tempest-TestServerVolumeAttachmentScenario-545311160 None] Deleting attachment 5bf0da80-fd02-4720-b964-548a4d3933d0. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:42 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:17:42 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:42 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.291s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:17:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:17:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "cinder-90dd5177-310d-4132-8082-bc493dfa262a-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-90dd5177-310d-4132-8082-bc493dfa262a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "cinder-quobyte-90dd5177-310d-4132-8082-bc493dfa262a" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-quobyte-90dd5177-310d-4132-8082-bc493dfa262a" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e8eb0-df32-45ee-aeaf-c88f02bfdac0]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:45 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a Jul 19 13:17:45 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:45 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a" returned: 0 in 0.395s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:45 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a Jul 19 13:17:45 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:45 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-90dd5177-310d-4132-8082-bc493dfa262a" returned: 0 in 0.274s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-quobyte-90dd5177-310d-4132-8082-bc493dfa262a" released by "delete_volume" :: held 0.715s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Created reservations ['93c8634d-4cbb-410f-ae32-418c764e0f2e', '8f7631a0-dae5-49d4-959c-7566b467b090', 'b49614ed-2407-4052-bc00-ba2fef70b8e3', '4b90eabf-a845-475d-b69a-2b4102538b76'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:45 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:17:45 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:46 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.272s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:17:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Deleted volume successfully. Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "cinder-8ed50390-d90a-4c21-b550-ed20162d4ae6-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e893a00-1714-492d-bdf9-74e73530d031 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-90dd5177-310d-4132-8082-bc493dfa262a-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-8ed50390-d90a-4c21-b550-ed20162d4ae6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "cinder-quobyte-8ed50390-d90a-4c21-b550-ed20162d4ae6" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-quobyte-8ed50390-d90a-4c21-b550-ed20162d4ae6" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da07dcef-ab23-4727-8e15-1a464460e050]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:46 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 Jul 19 13:17:46 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:46 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6" returned: 0 in 0.398s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:46 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6 Jul 19 13:17:46 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:46 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8ed50390-d90a-4c21-b550-ed20162d4ae6" returned: 0 in 0.255s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-quobyte-8ed50390-d90a-4c21-b550-ed20162d4ae6" released by "delete_volume" :: held 0.696s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:46 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Created reservations ['88ff6cf4-81b6-470b-90fe-df9452687203', 'bea87edd-f681-4dc5-b4f1-b5bd34a82e5c', 'a75319cc-33d4-4f67-99f2-d73fd1b6a2be', 'eb28d61b-3bc0-408f-aa5c-03bd46b7147b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:17:47 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:17:47 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:17:47 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.282s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:17:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Deleted volume successfully. Jul 19 13:17:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ad9ec3a-78fb-4701-b454-722df29cb087 tempest-TestServerVolumeAttachmentScenario-545311160 None] Lock "cinder-8ed50390-d90a-4c21-b550-ed20162d4ae6-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:17:57 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=44,cinder:SELECT=59,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:17:57 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=38,cinder:UPDATE=50,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Flow 'volume_create_manager' (c1feec83-963f-484a-bb0b-053e07aaa2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8867557a-7642-4ca5-9a21-dfd386edce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8867557a-7642-4ca5-9a21-dfd386edce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1987604859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53552d33-6af3-452b-a8ad-ed720aeee1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0924bb2cdf89465fac4007be78d76b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:18:14Z,use_quota=True,user_id='3b5c39dbbeaa47d88c31b5030f8bfc45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd45866-8bc8-452c-9a35-89938ef3c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd45866-8bc8-452c-9a35-89938ef3c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e613132-38b2-43ca-8c9b-0b97cc2286e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e613132-38b2-43ca-8c9b-0b97cc2286e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53552d33-6af3-452b-a8ad-ed720aeee1c9', 'volume_name': 'volume-53552d33-6af3-452b-a8ad-ed720aeee1c9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655c98a7-cfd1-4ee2-ba02-e548baf996a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655c98a7-cfd1-4ee2-ba02-e548baf996a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d304ae-6480-433f-91b5-0c0f6a5878b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Volume 53552d33-6af3-452b-a8ad-ed720aeee1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53552d33-6af3-452b-a8ad-ed720aeee1c9', 'volume_size': 1} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1987604859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53552d33-6af3-452b-a8ad-ed720aeee1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0924bb2cdf89465fac4007be78d76b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:18:14Z,use_quota=True,user_id='3b5c39dbbeaa47d88c31b5030f8bfc45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Creating volume 53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:18:14 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:14 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 1073741824 Jul 19 13:18:14 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:14 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 1073741824" returned: 0 in 0.421s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:14 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 Jul 19 13:18:14 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:15 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:18:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:18:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d304ae-6480-433f-91b5-0c0f6a5878b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53552d33-6af3-452b-a8ad-ed720aeee1c9', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb37b6-03c9-4891-ab85-eb12dc829f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:15 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Volume volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 (53552d33-6af3-452b-a8ad-ed720aeee1c9): created successfully Jul 19 13:18:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb37b6-03c9-4891-ab85-eb12dc829f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Flow 'volume_create_manager' (c1feec83-963f-484a-bb0b-053e07aaa2da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:18:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d0d47668-4667-4788-8abb-d1da7ff37a70 tempest-TestStampPattern-1576835636 None] Created volume successfully. Jul 19 13:18:25 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:18:25 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:42 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:18:42 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:42 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.239s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:18:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:18:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-0a7a1a85-07e8-4e3c-8f29-193530240440 req-072a2d14-cd10-4536-9730-709074d6351a tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-0a7a1a85-07e8-4e3c-8f29-193530240440 req-072a2d14-cd10-4536-9730-709074d6351a tempest-TestStampPattern-1576835636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-0a7a1a85-07e8-4e3c-8f29-193530240440 req-072a2d14-cd10-4536-9730-709074d6351a tempest-TestStampPattern-1576835636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:18:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-0a7a1a85-07e8-4e3c-8f29-193530240440 req-072a2d14-cd10-4536-9730-709074d6351a tempest-TestStampPattern-1576835636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-53552d33-6af3-452b-a8ad-ed720aeee1c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51503717-a0e2-488f-b15b-9efebe672de4', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:18:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-0a7a1a85-07e8-4e3c-8f29-193530240440 req-072a2d14-cd10-4536-9730-709074d6351a tempest-TestStampPattern-1576835636 None] attachment_update completed successfully. Jul 19 13:18:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-688ed3bd-7873-4195-93f1-3a77ac7af424 req-b79376f7-1f30-4e39-ae85-1e4ec9c66bb6 tempest-TestStampPattern-1576835636 None] Terminate volume connection completed successfully. Jul 19 13:18:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-688ed3bd-7873-4195-93f1-3a77ac7af424 req-b79376f7-1f30-4e39-ae85-1e4ec9c66bb6 tempest-TestStampPattern-1576835636 None] Deleting attachment 51503717-a0e2-488f-b15b-9efebe672de4. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:18:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Creating offline snapshot f1b5ee4f-969b-42aa-834a-3a246b670e2e of volume 53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:18:48 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075aab0-9bdd-4c1d-b2cc-5b00d1d5876a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:18:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:48 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 Jul 19 13:18:48 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:48 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9" returned: 0 in 0.357s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:48 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e 1G Jul 19 13:18:48 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:49 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e 1G" returned: 0 in 0.382s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:49 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e Jul 19 13:18:49 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:49 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e" returned: 0 in 0.292s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:49 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e is being set with open permissions: ugo+rw Jul 19 13:18:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:49 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e Jul 19 13:18:49 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:49 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e" returned: 0 in 0.238s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:49 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.info Jul 19 13:18:49 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:50 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.info" returned: 0 in 0.244s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:50 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.info is being set with open permissions: ugo+rw Jul 19 13:18:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:50 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.info Jul 19 13:18:50 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:50 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.info" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:18:50 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f0b01590-8519-4b40-8abe-0d62df0d2dbf tempest-TestStampPattern-1576835636 None] Create snapshot completed successfully Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Flow 'volume_create_manager' (d6eda078-223a-4cf1-abf8-fb90e097656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7234391-9098-43ba-8760-88697e74cd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7234391-9098-43ba-8760-88697e74cd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-296647802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf82e389-ce2a-44c6-8515-c8c2769008e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0924bb2cdf89465fac4007be78d76b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f1b5ee4f-969b-42aa-834a-3a246b670e2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:18:57Z,use_quota=True,user_id='3b5c39dbbeaa47d88c31b5030f8bfc45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f41b74-94f6-4c80-bf14-e04d8253c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f41b74-94f6-4c80-bf14-e04d8253c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcf6e7f-3815-4f05-9550-0e013f781a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcf6e7f-3815-4f05-9550-0e013f781a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf82e389-ce2a-44c6-8515-c8c2769008e6', 'volume_name': 'volume-cf82e389-ce2a-44c6-8515-c8c2769008e6', 'volume_size': 1, 'snapshot_id': 'f1b5ee4f-969b-42aa-834a-3a246b670e2e'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e579994-b261-49f3-b46c-13e6f03d564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e579994-b261-49f3-b46c-13e6f03d564a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb180a7-9f69-4bf3-9a67-d0527117b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:18:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Volume cf82e389-ce2a-44c6-8515-c8c2769008e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf82e389-ce2a-44c6-8515-c8c2769008e6', 'volume_size': 1, 'snapshot_id': 'f1b5ee4f-969b-42aa-834a-3a246b670e2e'} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-quobyte-f1b5ee4f-969b-42aa-834a-3a246b670e2e-cf82e389-ce2a-44c6-8515-c8c2769008e6" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-f1b5ee4f-969b-42aa-834a-3a246b670e2e-cf82e389-ce2a-44c6-8515-c8c2769008e6" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Creating volume cf82e389-ce2a-44c6-8515-c8c2769008e6 from snapshot f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-quobyte-cf82e389-ce2a-44c6-8515-c8c2769008e6" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-cf82e389-ce2a-44c6-8515-c8c2769008e6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] snapshot: f1b5ee4f-969b-42aa-834a-3a246b670e2e, volume: cf82e389-ce2a-44c6-8515-c8c2769008e6, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd70e21-413b-49a2-9917-d9f975b6e002]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:57 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e Jul 19 13:18:57 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:57 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e" returned: 0 in 0.396s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53552d33-6af3-452b-a8ad-ed720aeee1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b99415-5fe2-4b10-af55-43de7a96cdd0]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:18:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:57 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 Jul 19 13:18:57 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:18:58 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 19 13:18:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9" returned: 0 in 0.378s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:18:58 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:18:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:18:58 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 Jul 19 13:18:58 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:03 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6" returned: 0 in 5.629s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:03 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef96fbc-8fdd-473a-986c-6fffbab7d530]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:19:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:03 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 Jul 19 13:19:03 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:04 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9" returned: 0 in 0.585s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:19:04 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Converted 1024.00 MB image at 181.88 MB/s Jul 19 13:19:04 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 is being set with open permissions: ugo+rw Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:04 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 Jul 19 13:19:04 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:04 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6" returned: 0 in 0.274s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-cf82e389-ce2a-44c6-8515-c8c2769008e6" released by "_copy_volume_from_snapshot" :: held 7.374s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-f1b5ee4f-969b-42aa-834a-3a246b670e2e-cf82e389-ce2a-44c6-8515-c8c2769008e6" released by "_create_volume_from_snapshot" :: held 7.405s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.422s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb180a7-9f69-4bf3-9a67-d0527117b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf82e389-ce2a-44c6-8515-c8c2769008e6', 'volume_size': 1, 'snapshot_id': 'f1b5ee4f-969b-42aa-834a-3a246b670e2e'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58dce18-36cb-4434-8a54-8a35449669a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:19:04 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Volume volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 (cf82e389-ce2a-44c6-8515-c8c2769008e6): created successfully Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58dce18-36cb-4434-8a54-8a35449669a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:19:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Flow 'volume_create_manager' (d6eda078-223a-4cf1-abf8-fb90e097656a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:19:04 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-eedaa049-460d-42ae-9095-06ee52daa31b tempest-TestStampPattern-1576835636 None] Created volume successfully. Jul 19 13:19:14 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:19:14 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:42 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:19:42 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:42 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.247s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:19:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:19:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-2551f5cc-f733-4061-8e56-0524aa096735 req-a29e6b9d-f78e-4291-a827-3cd3fe139a29 tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:19:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-2551f5cc-f733-4061-8e56-0524aa096735 req-a29e6b9d-f78e-4291-a827-3cd3fe139a29 tempest-TestStampPattern-1576835636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:19:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aac02d-dd4e-4083-8ac1-d6df0d5fc017]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:19:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-2551f5cc-f733-4061-8e56-0524aa096735 req-a29e6b9d-f78e-4291-a827-3cd3fe139a29 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:46 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 Jul 19 13:19:46 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:47 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [req-2551f5cc-f733-4061-8e56-0524aa096735 req-a29e6b9d-f78e-4291-a827-3cd3fe139a29 tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6" returned: 0 in 0.347s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [req-2551f5cc-f733-4061-8e56-0524aa096735 req-a29e6b9d-f78e-4291-a827-3cd3fe139a29 tempest-TestStampPattern-1576835636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.371s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:19:47 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-2551f5cc-f733-4061-8e56-0524aa096735 req-a29e6b9d-f78e-4291-a827-3cd3fe139a29 tempest-TestStampPattern-1576835636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4', 'name': 'volume-cf82e389-ce2a-44c6-8515-c8c2769008e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6231efef-51b8-448c-8273-9eaeca8119dc', 'enforce_multipath': True} {{(pid=87305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 13:19:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-2551f5cc-f733-4061-8e56-0524aa096735 req-a29e6b9d-f78e-4291-a827-3cd3fe139a29 tempest-TestStampPattern-1576835636 None] attachment_update completed successfully. Jul 19 13:19:49 devstack cinder-volume[87305]: INFO cinder.volume.manager [req-26626a63-e5ba-4083-b107-45d22885112d req-8a3e08ac-d7d3-4cb7-8a87-68b8736edd44 tempest-TestStampPattern-1576835636 None] Terminate volume connection completed successfully. Jul 19 13:19:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [req-26626a63-e5ba-4083-b107-45d22885112d req-8a3e08ac-d7d3-4cb7-8a87-68b8736edd44 tempest-TestStampPattern-1576835636 None] Deleting attachment 6231efef-51b8-448c-8273-9eaeca8119dc. {{(pid=87305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 13:19:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-cf82e389-ce2a-44c6-8515-c8c2769008e6-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:19:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Lock "cinder-cf82e389-ce2a-44c6-8515-c8c2769008e6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:19:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-quobyte-cf82e389-ce2a-44c6-8515-c8c2769008e6" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:19:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-cf82e389-ce2a-44c6-8515-c8c2769008e6" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa853bcb-b788-4ce4-9449-f3846880b8d9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:54 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 Jul 19 13:19:54 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:54 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6" returned: 0 in 0.355s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:54 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6 Jul 19 13:19:54 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:54 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-cf82e389-ce2a-44c6-8515-c8c2769008e6" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-cf82e389-ce2a-44c6-8515-c8c2769008e6" released by "delete_volume" :: held 0.638s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Created reservations ['59704119-9ea6-47b7-bb44-73fe8a8a9518', 'd87f091f-a3f3-41d5-a175-5c67b4623824', '821a5010-1851-459f-afae-06e0c04f5db6', '9e3a365d-e6a7-490b-b558-86eeb1405663'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:54 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:19:54 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:54 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.238s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:19:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Deleted volume successfully. Jul 19 13:19:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6c7f97b0-fc79-46a9-86b2-f1fc5239c461 tempest-TestStampPattern-1576835636 None] Lock "cinder-cf82e389-ce2a-44c6-8515-c8c2769008e6-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-f1b5ee4f-969b-42aa-834a-3a246b670e2e-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Lock "cinder-f1b5ee4f-969b-42aa-834a-3a246b670e2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-quobyte-53552d33-6af3-452b-a8ad-ed720aeee1c9" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-53552d33-6af3-452b-a8ad-ed720aeee1c9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-quobyte-f1b5ee4f-969b-42aa-834a-3a246b670e2e" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-f1b5ee4f-969b-42aa-834a-3a246b670e2e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Deleting offline snapshot f1b5ee4f-969b-42aa-834a-3a246b670e2e of volume 53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] snapshot_file for this snap is: volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19938ad8-1f21-4a94-bde1-82c9a1ca2673]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:55 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e Jul 19 13:19:55 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:55 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53552d33-6af3-452b-a8ad-ed720aeee1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e505739-b201-4395-ad1f-5605b8c7fa98]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:19:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:55 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 Jul 19 13:19:55 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:56 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9" returned: 0 in 0.341s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:56 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e Jul 19 13:19:56 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:56 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e" returned: 0 in 0.336s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:19:56 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e Jul 19 13:19:56 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:19:56 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9.f1b5ee4f-969b-42aa-834a-3a246b670e2e" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-f1b5ee4f-969b-42aa-834a-3a246b670e2e" released by "_delete_snapshot" :: held 1.364s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-53552d33-6af3-452b-a8ad-ed720aeee1c9" released by "delete_snapshot" :: held 1.385s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Created reservations ['746d0b25-a4ad-49fd-a5ad-d9e2cfad5257', '01baa6f0-14bb-42f0-8e75-3003a9177037', '9b0fa499-1191-4070-a9a8-edb9c3b821be', '9554d109-f32c-40f8-955e-332543f0fed2'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:19:56 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Delete snapshot completed successfully. Jul 19 13:19:56 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0210f1fe-57ba-4b55-a7cf-476e0389e7c1 tempest-TestStampPattern-1576835636 None] Lock "cinder-f1b5ee4f-969b-42aa-834a-3a246b670e2e-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-53552d33-6af3-452b-a8ad-ed720aeee1c9-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Lock "cinder-53552d33-6af3-452b-a8ad-ed720aeee1c9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Acquiring lock "cinder-quobyte-53552d33-6af3-452b-a8ad-ed720aeee1c9" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-53552d33-6af3-452b-a8ad-ed720aeee1c9" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:00 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef389e9-f63c-4b62-8c1b-dc7a5716537e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:01 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 Jul 19 13:20:01 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:01 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:01 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9 Jul 19 13:20:01 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:01 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-53552d33-6af3-452b-a8ad-ed720aeee1c9" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Lock "cinder-quobyte-53552d33-6af3-452b-a8ad-ed720aeee1c9" released by "delete_volume" :: held 0.638s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Created reservations ['8cb90746-7591-4958-b494-e763c77461a2', 'c33c433b-6de1-4659-b1a9-d36af0317049', 'd8ec2f47-3b7b-4e46-a76b-e5d7a301dcbb', '631eea54-6f0c-4196-9758-d566996957a8'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:01 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:01 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:01 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.234s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:01 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Deleted volume successfully. Jul 19 13:20:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bc4f3b1a-1e7a-458b-86e7-1e297dbea9f1 tempest-TestStampPattern-1576835636 None] Lock "cinder-53552d33-6af3-452b-a8ad-ed720aeee1c9-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:11 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:20:11 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=22,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:20:11 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (d0dfc6ec-31f7-40f4-97e0-7de93a7328c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ab32d1-8075-4322-b589-bc74d4d3ab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ab32d1-8075-4322-b589-bc74d4d3ab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1416700043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c90fe1-4c56-4f21-a091-53ab577c966f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:12Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89685cc2-fd44-45a4-8ecc-fb45c0089336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89685cc2-fd44-45a4-8ecc-fb45c0089336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb627dfa-a752-442e-80f2-e6944fa2be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb627dfa-a752-442e-80f2-e6944fa2be43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c90fe1-4c56-4f21-a091-53ab577c966f', 'volume_name': 'volume-81c90fe1-4c56-4f21-a091-53ab577c966f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c9ef28-9d58-4057-bda9-f332f567f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c9ef28-9d58-4057-bda9-f332f567f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc45d5fe-0ae3-4a60-9d83-e6e946d2a1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:12 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume 81c90fe1-4c56-4f21-a091-53ab577c966f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c90fe1-4c56-4f21-a091-53ab577c966f', 'volume_size': 1} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1416700043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c90fe1-4c56-4f21-a091-53ab577c966f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:12Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Creating volume 81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:12 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:12 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f 1073741824 Jul 19 13:20:12 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:12 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f 1073741824" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:12 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f Jul 19 13:20:12 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:12 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f" returned: 0 in 0.236s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc45d5fe-0ae3-4a60-9d83-e6e946d2a1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c90fe1-4c56-4f21-a091-53ab577c966f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51761564-8ab8-40a5-a8b0-0fc9341932b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:12 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume volume-81c90fe1-4c56-4f21-a091-53ab577c966f (81c90fe1-4c56-4f21-a091-53ab577c966f): created successfully Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51761564-8ab8-40a5-a8b0-0fc9341932b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (d0dfc6ec-31f7-40f4-97e0-7de93a7328c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-85e4b75b-870f-411d-9d0f-309b4da286e2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created volume successfully. Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Creating offline snapshot 2c4bcbab-0ebf-4133-8a37-94306beeca0b of volume 81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017d523-71f3-485e-abe8-8f4bfb59df53]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:13 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f Jul 19 13:20:13 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:13 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f" returned: 0 in 0.366s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:13 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b 1G Jul 19 13:20:13 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:13 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b 1G" returned: 0 in 0.386s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c90fe1-4c56-4f21-a091-53ab577c966f -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:13 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c90fe1-4c56-4f21-a091-53ab577c966f -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b Jul 19 13:20:13 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:14 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c90fe1-4c56-4f21-a091-53ab577c966f -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:14 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b is being set with open permissions: ugo+rw Jul 19 13:20:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:14 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b Jul 19 13:20:14 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:14 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b" returned: 0 in 0.241s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:14 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.info Jul 19 13:20:14 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:14 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.info" returned: 0 in 0.250s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:14 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.info is being set with open permissions: ugo+rw Jul 19 13:20:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:14 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.info Jul 19 13:20:14 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:15 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.info" returned: 0 in 0.242s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-59f6c575-6b77-4c76-9ce6-324feb9243bb tempest-CreateVolumesFromSnapshotTest-452506198 None] Create snapshot completed successfully Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (8d206cec-ddd0-40bc-9a15-f2a8f0a72ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678466bb-d2fa-4f49-966b-c5a3eb803f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678466bb-d2fa-4f49-966b-c5a3eb803f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736950223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1774451-0b6d-42dd-9927-d1b58189ce5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:16Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0335dc5-64df-4534-993e-439d81f9ca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0335dc5-64df-4534-993e-439d81f9ca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c1c4f9-1f25-4e39-a5fc-56ad36620cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c1c4f9-1f25-4e39-a5fc-56ad36620cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1774451-0b6d-42dd-9927-d1b58189ce5a', 'volume_name': 'volume-f1774451-0b6d-42dd-9927-d1b58189ce5a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515611cd-f4bb-4982-b5a3-6daf9363021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515611cd-f4bb-4982-b5a3-6daf9363021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cef0583-be30-4bf2-a561-7de1f29c9445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:15 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume f1774451-0b6d-42dd-9927-d1b58189ce5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1774451-0b6d-42dd-9927-d1b58189ce5a', 'volume_size': 1} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736950223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1774451-0b6d-42dd-9927-d1b58189ce5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:16Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Creating volume f1774451-0b6d-42dd-9927-d1b58189ce5a {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:15 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:15 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a 1073741824 Jul 19 13:20:15 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (49af3286-0d61-43a0-b28b-27a61282cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8011e2-12f7-4368-8908-a37e60260c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8011e2-12f7-4368-8908-a37e60260c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586643850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6966c01f-6841-4e67-a629-db44913e002b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:16Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38278a90-a8a9-4487-87d6-9d3ff2454ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38278a90-a8a9-4487-87d6-9d3ff2454ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b3a754-7052-4749-a435-65356ed64b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b3a754-7052-4749-a435-65356ed64b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6966c01f-6841-4e67-a629-db44913e002b', 'volume_name': 'volume-6966c01f-6841-4e67-a629-db44913e002b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b8bc5b-5830-4d5f-93e7-ceedfd82e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b8bc5b-5830-4d5f-93e7-ceedfd82e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a72a039-8862-4f23-bebb-be15b96856a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume 6966c01f-6841-4e67-a629-db44913e002b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6966c01f-6841-4e67-a629-db44913e002b', 'volume_size': 1} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:16 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a 1073741824" returned: 0 in 0.454s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:16 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a Jul 19 13:20:16 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (498db47a-6cd4-4521-afa0-cd6e3ef7bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7ae2d4-80a3-4237-869d-3af274ecf247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7ae2d4-80a3-4237-869d-3af274ecf247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145519162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:16Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dff785-4136-4973-a3a2-3ca6aa1d36ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dff785-4136-4973-a3a2-3ca6aa1d36ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e419cf07-2153-4334-900d-9137e1927bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e419cf07-2153-4334-900d-9137e1927bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb', 'volume_name': 'volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5ce0d0-58f5-4ad5-a948-5895f9179e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5ce0d0-58f5-4ad5-a948-5895f9179e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb314671-d936-4009-8315-5102268b0c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume 6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb', 'volume_size': 1} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:16 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a" returned: 0 in 0.278s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586643850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6966c01f-6841-4e67-a629-db44913e002b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:16Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Creating volume 6966c01f-6841-4e67-a629-db44913e002b {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:16 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cef0583-be30-4bf2-a561-7de1f29c9445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1774451-0b6d-42dd-9927-d1b58189ce5a', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b 1073741824 Jul 19 13:20:16 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d879ae-5f8e-48d9-86bf-54ec4ea45f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume volume-f1774451-0b6d-42dd-9927-d1b58189ce5a (f1774451-0b6d-42dd-9927-d1b58189ce5a): created successfully Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d879ae-5f8e-48d9-86bf-54ec4ea45f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (8d206cec-ddd0-40bc-9a15-f2a8f0a72ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b77f62bc-63f6-4102-bddb-983254eec7c1 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created volume successfully. Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (47b1c4e2-1747-4409-9c8e-a3116f660cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf2f544-94f3-4967-b70a-a03904dca067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf2f544-94f3-4967-b70a-a03904dca067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1295539227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd8f026-e56c-4567-a261-027ab79a9c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:17Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92195700-db5d-4369-94be-ae76966638b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92195700-db5d-4369-94be-ae76966638b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf6aafc-b7fe-4f46-852b-7c383db748d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf6aafc-b7fe-4f46-852b-7c383db748d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd8f026-e56c-4567-a261-027ab79a9c1f', 'volume_name': 'volume-bdd8f026-e56c-4567-a261-027ab79a9c1f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a50ff4-bf49-4322-80d9-49f95b6df465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a50ff4-bf49-4322-80d9-49f95b6df465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77845eb6-da71-43f6-990c-494144e431d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:16 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume bdd8f026-e56c-4567-a261-027ab79a9c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd8f026-e56c-4567-a261-027ab79a9c1f', 'volume_size': 1} Jul 19 13:20:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:17 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b 1073741824" returned: 0 in 0.477s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (d751c0e3-9563-4e97-a3e2-f37a06c1aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608b42f5-8635-4fce-a15b-e65836e127ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608b42f5-8635-4fce-a15b-e65836e127ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182801968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8029ba97-ec3f-46d8-815a-4d1bea00347f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:17Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67fdb01-9ca8-408f-aded-57406ade98cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67fdb01-9ca8-408f-aded-57406ade98cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4184bf1b-79ab-4fe4-9535-b9d5ea173d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4184bf1b-79ab-4fe4-9535-b9d5ea173d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8029ba97-ec3f-46d8-815a-4d1bea00347f', 'volume_name': 'volume-8029ba97-ec3f-46d8-815a-4d1bea00347f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4915e95-fbce-4c3c-8cb9-545ca321f43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4915e95-fbce-4c3c-8cb9-545ca321f43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcd379b-1b2e-4ca8-be9f-73e96c4145d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:17 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume 8029ba97-ec3f-46d8-815a-4d1bea00347f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8029ba97-ec3f-46d8-815a-4d1bea00347f', 'volume_size': 1} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:17 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b Jul 19 13:20:17 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:17 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b" returned: 0 in 0.236s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145519162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:16Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Creating volume 6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:17 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a72a039-8862-4f23-bebb-be15b96856a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6966c01f-6841-4e67-a629-db44913e002b', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf88b0f-3aed-41c0-af1b-965abf09a467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:17 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb 1073741824 Jul 19 13:20:17 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:17 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume volume-6966c01f-6841-4e67-a629-db44913e002b (6966c01f-6841-4e67-a629-db44913e002b): created successfully Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf88b0f-3aed-41c0-af1b-965abf09a467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (49af3286-0d61-43a0-b28b-27a61282cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-54b6ddf1-db46-4231-83ff-538447c12e10 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created volume successfully. Jul 19 13:20:17 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb 1073741824" returned: 0 in 0.404s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:17 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb Jul 19 13:20:17 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:18 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb" returned: 0 in 0.246s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1295539227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd8f026-e56c-4567-a261-027ab79a9c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:17Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Creating volume bdd8f026-e56c-4567-a261-027ab79a9c1f {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:18 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb314671-d936-4009-8315-5102268b0c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f737f1ab-438a-4723-bb70-e08539f0aaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:18 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f 1073741824 Jul 19 13:20:18 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb (6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb): created successfully Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f737f1ab-438a-4723-bb70-e08539f0aaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (498db47a-6cd4-4521-afa0-cd6e3ef7bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-97c586f6-209f-4ac7-a16f-628ebf2dabd0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created volume successfully. Jul 19 13:20:18 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f 1073741824" returned: 0 in 0.405s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:18 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f Jul 19 13:20:18 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:18 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f" returned: 0 in 0.234s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182801968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8029ba97-ec3f-46d8-815a-4d1bea00347f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb00d74a8ae44761b3f023323e4aa38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:17Z,use_quota=True,user_id='9abfa61c8dd84a62af2652c668b54abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Creating volume 8029ba97-ec3f-46d8-815a-4d1bea00347f {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:18 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77845eb6-da71-43f6-990c-494144e431d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd8f026-e56c-4567-a261-027ab79a9c1f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:18 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f 1073741824 Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad43f0d-cb5b-4661-91a6-88cdf9f09c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:18 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume volume-bdd8f026-e56c-4567-a261-027ab79a9c1f (bdd8f026-e56c-4567-a261-027ab79a9c1f): created successfully Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad43f0d-cb5b-4661-91a6-88cdf9f09c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (47b1c4e2-1747-4409-9c8e-a3116f660cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d3b80fc5-1cf7-4c65-9c7a-0af5fd104a0a tempest-CreateVolumesFromSnapshotTest-452506198 None] Created volume successfully. Jul 19 13:20:19 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f 1073741824" returned: 0 in 0.423s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:19 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f Jul 19 13:20:19 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:19 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcd379b-1b2e-4ca8-be9f-73e96c4145d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8029ba97-ec3f-46d8-815a-4d1bea00347f', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf97fdd-e7fd-44a2-a51b-7c75a46b6de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:19 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Volume volume-8029ba97-ec3f-46d8-815a-4d1bea00347f (8029ba97-ec3f-46d8-815a-4d1bea00347f): created successfully Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf97fdd-e7fd-44a2-a51b-7c75a46b6de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:19 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Flow 'volume_create_manager' (d751c0e3-9563-4e97-a3e2-f37a06c1aba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:19 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6ecf1e05-6be3-442c-862e-3238a501a3e0 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created volume successfully. Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-8029ba97-ec3f-46d8-815a-4d1bea00347f-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-8029ba97-ec3f-46d8-815a-4d1bea00347f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-8029ba97-ec3f-46d8-815a-4d1bea00347f" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-8029ba97-ec3f-46d8-815a-4d1bea00347f" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1245413d-0618-45d8-8b16-cf26c7bfd9ae]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:20 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f Jul 19 13:20:20 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:20 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f" returned: 0 in 0.366s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:20 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f Jul 19 13:20:20 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:21 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8029ba97-ec3f-46d8-815a-4d1bea00347f" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-8029ba97-ec3f-46d8-815a-4d1bea00347f" released by "delete_volume" :: held 0.642s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Created reservations ['a6feb699-1c62-423c-a13c-97e7ac42abaa', '49f4c59f-c4aa-410b-ad0c-116ef23b598b', '3368613d-9779-4e99-98f0-8d25d89168ab', '979e6c7c-6792-4dc4-8d83-e68d287ee05d'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:21 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:21 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:21 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.244s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Deleted volume successfully. Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a0c7995a-d99e-449d-a9fd-172320e329cd tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-8029ba97-ec3f-46d8-815a-4d1bea00347f-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-bdd8f026-e56c-4567-a261-027ab79a9c1f-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-bdd8f026-e56c-4567-a261-027ab79a9c1f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-bdd8f026-e56c-4567-a261-027ab79a9c1f" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-bdd8f026-e56c-4567-a261-027ab79a9c1f" acquired by "delete_volume" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49e0b0d-c077-449b-93e9-652cd8799b4a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:21 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f Jul 19 13:20:21 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:22 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f" returned: 0 in 0.338s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:22 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f Jul 19 13:20:22 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:22 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-bdd8f026-e56c-4567-a261-027ab79a9c1f" returned: 0 in 0.248s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-bdd8f026-e56c-4567-a261-027ab79a9c1f" released by "delete_volume" :: held 0.625s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created reservations ['4d092416-1e15-46bd-8000-2eddbb870f19', 'e4ed7dd3-eea3-4e31-b5e0-306ba6691061', '68e2e12c-caad-4605-b3ea-68662abbd522', 'f00b6cbe-cf99-4af4-b721-5a316083a557'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:22 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:22 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:22 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Deleted volume successfully. Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6a3f7e62-07bb-4483-b660-1fba10a1a4d2 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-bdd8f026-e56c-4567-a261-027ab79a9c1f-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd9f2d7-9c3c-4447-8970-179f40200ec7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:22 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb Jul 19 13:20:22 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:23 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb" returned: 0 in 0.349s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:23 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb Jul 19 13:20:23 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:23 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb" released by "delete_volume" :: held 0.628s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created reservations ['70476600-72ef-49c4-8b51-47f329dccf59', '4cf9a41e-ba6e-482c-8770-580cc9fadddf', '67ec88f5-829b-4755-a293-57af8e07c66c', '0eb4b03c-7ba5-4084-b400-4a441cacacc5'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:23 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:23 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:23 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.238s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Deleted volume successfully. Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f3d54ad2-156c-41d1-9acf-b7bd03f83103 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-6b1d6898-1b3f-4828-87d8-6f5f02bb7aeb-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-6966c01f-6841-4e67-a629-db44913e002b-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-6966c01f-6841-4e67-a629-db44913e002b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-6966c01f-6841-4e67-a629-db44913e002b" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-6966c01f-6841-4e67-a629-db44913e002b" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a5a32-10c2-431e-b068-5558da0329c5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:24 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b Jul 19 13:20:24 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:24 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:24 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b Jul 19 13:20:24 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:24 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6966c01f-6841-4e67-a629-db44913e002b" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-6966c01f-6841-4e67-a629-db44913e002b" released by "delete_volume" :: held 0.632s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created reservations ['bddd847f-c28c-4b83-8d89-615fdeaeeacb', '5f1dd295-d06f-4f25-980b-2e901f9e6add', 'faf11b1c-e56d-4c7a-9c1a-ca654a3babfc', '47d2a774-ae66-4cb2-8a18-7bb9b2b8c1a7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:24 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:24 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:24 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.242s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Deleted volume successfully. Jul 19 13:20:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8d917027-178f-4867-812b-7aff38b11299 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-6966c01f-6841-4e67-a629-db44913e002b-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-f1774451-0b6d-42dd-9927-d1b58189ce5a-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-f1774451-0b6d-42dd-9927-d1b58189ce5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-f1774451-0b6d-42dd-9927-d1b58189ce5a" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-f1774451-0b6d-42dd-9927-d1b58189ce5a" acquired by "delete_volume" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad0de05-1597-4e3e-9533-7a2871acd5c6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:25 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a Jul 19 13:20:25 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:25 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a" returned: 0 in 0.345s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:25 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a Jul 19 13:20:25 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:25 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f1774451-0b6d-42dd-9927-d1b58189ce5a" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-f1774451-0b6d-42dd-9927-d1b58189ce5a" released by "delete_volume" :: held 0.626s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Created reservations ['9a95e858-cac6-4c06-9be1-32dcf14da126', 'e790fcf9-081a-4f28-ae1a-0cf15117c85f', 'd0d9944a-61b4-438d-ac8a-705808e4fb45', '8b45b161-faae-4f0c-91f7-19afab3fbbb8'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:25 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:25 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:26 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.246s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Deleted volume successfully. Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a3b54ea6-2e8f-4ac7-b145-0b959a62db7a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-f1774451-0b6d-42dd-9927-d1b58189ce5a-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-2c4bcbab-0ebf-4133-8a37-94306beeca0b-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-2c4bcbab-0ebf-4133-8a37-94306beeca0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-81c90fe1-4c56-4f21-a091-53ab577c966f" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-81c90fe1-4c56-4f21-a091-53ab577c966f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-2c4bcbab-0ebf-4133-8a37-94306beeca0b" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-2c4bcbab-0ebf-4133-8a37-94306beeca0b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Deleting offline snapshot 2c4bcbab-0ebf-4133-8a37-94306beeca0b of volume 81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] snapshot_file for this snap is: volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5332a01f-aea6-49bb-97ad-2b2f5a487d3b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:26 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b Jul 19 13:20:26 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:26 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81c90fe1-4c56-4f21-a091-53ab577c966f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[426dcdfb-0e76-4c95-a363-8f3ed81fc550]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:26 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f Jul 19 13:20:26 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:27 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f" returned: 0 in 0.344s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:27 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b Jul 19 13:20:27 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:27 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b" returned: 0 in 0.319s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:27 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b Jul 19 13:20:27 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:27 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f.2c4bcbab-0ebf-4133-8a37-94306beeca0b" returned: 0 in 0.239s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-2c4bcbab-0ebf-4133-8a37-94306beeca0b" released by "_delete_snapshot" :: held 1.345s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-81c90fe1-4c56-4f21-a091-53ab577c966f" released by "delete_snapshot" :: held 1.365s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Created reservations ['7730c8a6-cc59-45a7-9cc7-c5fcc5e12898', '1cf5c5c0-6651-4cd3-9065-3b0cda56935b', '7c41ab26-b5e4-46c8-bdc3-3c7e4af2b3db', 'e14ca34c-582f-4b15-b38d-a928b9e8064d'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:27 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Delete snapshot completed successfully. Jul 19 13:20:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8ecfbd15-edab-442b-893c-a3b456a1070a tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-2c4bcbab-0ebf-4133-8a37-94306beeca0b-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-81c90fe1-4c56-4f21-a091-53ab577c966f-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-81c90fe1-4c56-4f21-a091-53ab577c966f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "cinder-quobyte-81c90fe1-4c56-4f21-a091-53ab577c966f" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-81c90fe1-4c56-4f21-a091-53ab577c966f" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93840454-b993-4362-9f93-c4f22b69f643]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:28 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f Jul 19 13:20:28 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:28 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f" returned: 0 in 0.348s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:28 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f Jul 19 13:20:28 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:29 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-81c90fe1-4c56-4f21-a091-53ab577c966f" returned: 0 in 0.238s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-quobyte-81c90fe1-4c56-4f21-a091-53ab577c966f" released by "delete_volume" :: held 0.639s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Created reservations ['873cfa1e-22a7-47a5-a6ce-9b57de2b2000', 'b5bd4b7a-c36b-4617-bb3a-9bfa55c8f12d', 'f5cc5cf5-ac34-46fb-8a2e-ad9037979e8d', '045dfeb7-3e38-44eb-a9ff-42f49c457ad4'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:29 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:29 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:29 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.230s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Deleted volume successfully. Jul 19 13:20:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-bdd206ec-18c7-4266-a411-e195cad10d57 tempest-CreateVolumesFromSnapshotTest-452506198 None] Lock "cinder-81c90fe1-4c56-4f21-a091-53ab577c966f-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Flow 'volume_create_manager' (cea6220a-6208-428f-b61b-5a33183c150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f75a227-1a7d-44e5-a469-0c3bac59256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f75a227-1a7d-44e5-a469-0c3bac59256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0189523a-d9f2-4ee5-8715-2b2a16de2545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961b2d59a80843c4a97c0208017a510d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:34Z,use_quota=True,user_id='c5ab771ced3d42f79fd33dfa7371daf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28874c0c-b285-4202-a13b-260cb46badf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28874c0c-b285-4202-a13b-260cb46badf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70551858-f12b-4598-901a-e8fe8f830b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70551858-f12b-4598-901a-e8fe8f830b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0189523a-d9f2-4ee5-8715-2b2a16de2545', 'volume_name': 'volume-0189523a-d9f2-4ee5-8715-2b2a16de2545', 'volume_size': 1, 'image_id': 'dcddc762-e145-4e05-8924-ab91d56a84e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcddc762-e145-4e05-8924-ab91d56a84e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cfebf5a35522927df234c61826390e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '961b2d59a80843c4a97c0208017a510d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c2ff4d6d7b72638aece66d6619df742ca26eb991e412cbc95240649f526796eb4a1db1c732758ddb98d2e3c230822129c264cde7063c854730cafab81344819', 'id': 'dcddc762-e145-4e05-8924-ab91d56a84e3', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcddc762-e145-4e05-8924-ab91d56a84e3/file', 'properties': {}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1754cd3-0543-44fe-a829-f247cb82f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1754cd3-0543-44fe-a829-f247cb82f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a617127-fb27-47a9-8467-8127e7ed98a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:34 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Volume 0189523a-d9f2-4ee5-8715-2b2a16de2545: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0189523a-d9f2-4ee5-8715-2b2a16de2545', 'volume_size': 1, 'image_id': 'dcddc762-e145-4e05-8924-ab91d56a84e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcddc762-e145-4e05-8924-ab91d56a84e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cfebf5a35522927df234c61826390e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '961b2d59a80843c4a97c0208017a510d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c2ff4d6d7b72638aece66d6619df742ca26eb991e412cbc95240649f526796eb4a1db1c732758ddb98d2e3c230822129c264cde7063c854730cafab81344819', 'id': 'dcddc762-e145-4e05-8924-ab91d56a84e3', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcddc762-e145-4e05-8924-ab91d56a84e3/file', 'properties': {}}, 'image_service': } Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Trying to clone 0189523a-d9f2-4ee5-8715-2b2a16de2545 from image dcddc762-e145-4e05-8924-ab91d56a84e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcddc762-e145-4e05-8924-ab91d56a84e3', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:20:34 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Image download 0.00 MB at 0.00 MB/s Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f19175-b2b4-4f04-8af2-f5ffc3611d11]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:34 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD Jul 19 13:20:34 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:34 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:35 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD Jul 19 13:20:35 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:35 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:35 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Temporary image dcddc762-e145-4e05-8924-ab91d56a84e3 is fetched for user c5ab771ced3d42f79fd33dfa7371daf5. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:20:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f58225-71d4-4ec3-b879-f3997aebfb61]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:35 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD Jul 19 13:20:35 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:35 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:35 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD Jul 19 13:20:35 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:36 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0189523a-d9f2-4ee5-8715-2b2a16de2545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961b2d59a80843c4a97c0208017a510d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:34Z,use_quota=True,user_id='c5ab771ced3d42f79fd33dfa7371daf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Creating volume 0189523a-d9f2-4ee5-8715-2b2a16de2545 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:36 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:36 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 1073741824 Jul 19 13:20:36 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:36 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 1073741824" returned: 0 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:36 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 Jul 19 13:20:36 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:36 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545" returned: 0 in 0.241s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Attempting download of dcddc762-e145-4e05-8924-ab91d56a84e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcddc762-e145-4e05-8924-ab91d56a84e3', 'metadata': {}}])) to volume 0189523a-d9f2-4ee5-8715-2b2a16de2545. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[836d2869-1c7f-404c-82b4-ae55850182f3]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcddc762-e145-4e05-8924-ab91d56a84e3_h3vw16rw {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:36 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcddc762-e145-4e05-8924-ab91d56a84e3_h3vw16rw Jul 19 13:20:36 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:37 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcddc762-e145-4e05-8924-ab91d56a84e3_h3vw16rw" returned: 0 in 0.317s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcddc762-e145-4e05-8924-ab91d56a84e3_h3vw16rw {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:37 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcddc762-e145-4e05-8924-ab91d56a84e3_h3vw16rw Jul 19 13:20:37 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:37 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcddc762-e145-4e05-8924-ab91d56a84e3_h3vw16rw" returned: 1 in 0.323s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcddc762-e145-4e05-8924-ab91d56a84e3_h3vw16rw' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0d8965-d080-44cf-9a36-07fdadcf59c9]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:37 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD Jul 19 13:20:37 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:37 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:37 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD Jul 19 13:20:37 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:38 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] dcddc762-e145-4e05-8924-ab91d56a84e3 was raw, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:38 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 Jul 19 13:20:38 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:38 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545" returned: 0 in 0.426s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcddc762-e145-4e05-8924-ab91d56a84e3_pu5gx4cydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:20:38 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:38 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 1G Jul 19 13:20:38 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:38 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 1G" returned: 0 in 0.296s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Downloaded image dcddc762-e145-4e05-8924-ab91d56a84e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcddc762-e145-4e05-8924-ab91d56a84e3', 'metadata': {}}])) to volume 0189523a-d9f2-4ee5-8715-2b2a16de2545 successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Temporary image dcddc762-e145-4e05-8924-ab91d56a84e3 for user c5ab771ced3d42f79fd33dfa7371daf5 is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Marking volume 0189523a-d9f2-4ee5-8715-2b2a16de2545 as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Copying metadata from image dcddc762-e145-4e05-8924-ab91d56a84e3 to 0189523a-d9f2-4ee5-8715-2b2a16de2545. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Creating volume glance metadata for volume 0189523a-d9f2-4ee5-8715-2b2a16de2545 backed by image dcddc762-e145-4e05-8924-ab91d56a84e3 with: {'image_id': 'dcddc762-e145-4e05-8924-ab91d56a84e3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0cfebf5a35522927df234c61826390e8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a617127-fb27-47a9-8467-8127e7ed98a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0189523a-d9f2-4ee5-8715-2b2a16de2545', 'volume_size': 1, 'image_id': 'dcddc762-e145-4e05-8924-ab91d56a84e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcddc762-e145-4e05-8924-ab91d56a84e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cfebf5a35522927df234c61826390e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '961b2d59a80843c4a97c0208017a510d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c2ff4d6d7b72638aece66d6619df742ca26eb991e412cbc95240649f526796eb4a1db1c732758ddb98d2e3c230822129c264cde7063c854730cafab81344819', 'id': 'dcddc762-e145-4e05-8924-ab91d56a84e3', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcddc762-e145-4e05-8924-ab91d56a84e3/file', 'properties': {}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c340b1-daf0-476d-bed9-0c1d0af430f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:38 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Volume volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 (0189523a-d9f2-4ee5-8715-2b2a16de2545): created successfully Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c340b1-daf0-476d-bed9-0c1d0af430f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Flow 'volume_create_manager' (cea6220a-6208-428f-b61b-5a33183c150a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-32198bae-f6ea-4800-874e-8ce7871a196a tempest-VolumeImageDependencyTests-509146563 None] Created volume successfully. Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Acquiring lock "cinder-0189523a-d9f2-4ee5-8715-2b2a16de2545-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Lock "cinder-0189523a-d9f2-4ee5-8715-2b2a16de2545-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Acquiring lock "cinder-quobyte-0189523a-d9f2-4ee5-8715-2b2a16de2545" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Lock "cinder-quobyte-0189523a-d9f2-4ee5-8715-2b2a16de2545" acquired by "delete_volume" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72d0c62-50ba-4ea3-b389-79715f2c87f4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:39 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 Jul 19 13:20:39 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:39 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545" returned: 0 in 0.342s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:39 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545 Jul 19 13:20:39 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:40 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0189523a-d9f2-4ee5-8715-2b2a16de2545" returned: 0 in 0.250s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Lock "cinder-quobyte-0189523a-d9f2-4ee5-8715-2b2a16de2545" released by "delete_volume" :: held 0.632s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Created reservations ['179be59c-51de-4db3-947b-40dd9d82e57d', '38ea40f5-c698-47ee-92f9-4cb19af8fd0f', 'fd59b271-c3a6-4a8a-981b-90b6e9b470e5', '4918abf2-51f1-4072-91af-1d08a09eb9a4'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:40 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:40 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:40 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Deleted volume successfully. Jul 19 13:20:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cc40f7bd-e473-48b1-9e56-149199df6bde tempest-VolumeImageDependencyTests-509146563 None] Lock "cinder-0189523a-d9f2-4ee5-8715-2b2a16de2545-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:42 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:20:42 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:42 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:20:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:20:50 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=65,cinder:UPDATE=90,cinder:DELETE=10,cinder:INSERT=25 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:20:50 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=82,cinder:SELECT=63,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (cdea2227-dfe1-477c-a453-fabce06675a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854a9b28-c7c6-42ee-83ff-9a081ba010f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854a9b28-c7c6-42ee-83ff-9a081ba010f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484673405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d7f075-e983-4959-a61f-c885ace52845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:52Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d94f3c-5e59-484b-ac01-0bf6643b7192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d94f3c-5e59-484b-ac01-0bf6643b7192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408d5ff2-e1e2-4343-a7c3-975f1e9f7d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408d5ff2-e1e2-4343-a7c3-975f1e9f7d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d7f075-e983-4959-a61f-c885ace52845', 'volume_name': 'volume-93d7f075-e983-4959-a61f-c885ace52845', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb8c175-dc50-4c14-9a91-e5ad466dce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb8c175-dc50-4c14-9a91-e5ad466dce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b638cfec-e194-4992-9499-849d1973d0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume 93d7f075-e983-4959-a61f-c885ace52845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d7f075-e983-4959-a61f-c885ace52845', 'volume_size': 1} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484673405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d7f075-e983-4959-a61f-c885ace52845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:52Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Creating volume 93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:52 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:52 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 1073741824 Jul 19 13:20:52 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Flow 'volume_create_manager' (b55df603-7007-4573-99c7-8ad46becec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d02db3-491d-4427-8eea-c6530f6531af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d02db3-491d-4427-8eea-c6530f6531af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa24337-9ade-40e9-b949-77a95552708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e40664b47324ca3ac5a3ed2ecde0b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:52Z,use_quota=True,user_id='2c9262888a544a9eb1cc33c1a80155a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0f7bd-312d-4244-90fa-1c7039d4f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0f7bd-312d-4244-90fa-1c7039d4f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680a13b7-75ad-48d0-9509-826138581184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680a13b7-75ad-48d0-9509-826138581184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa24337-9ade-40e9-b949-77a95552708c', 'volume_name': 'volume-8fa24337-9ade-40e9-b949-77a95552708c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db394f1-cde0-4dd8-8331-5948801ad242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db394f1-cde0-4dd8-8331-5948801ad242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365fcadc-e0c4-4c34-9141-7526446c3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:52 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Volume 8fa24337-9ade-40e9-b949-77a95552708c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa24337-9ade-40e9-b949-77a95552708c', 'volume_size': 1} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:52 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 1073741824" returned: 0 in 0.511s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:52 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 Jul 19 13:20:52 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:52 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845" returned: 0 in 0.275s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa24337-9ade-40e9-b949-77a95552708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e40664b47324ca3ac5a3ed2ecde0b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:52Z,use_quota=True,user_id='2c9262888a544a9eb1cc33c1a80155a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Creating volume 8fa24337-9ade-40e9-b949-77a95552708c {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:52 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b638cfec-e194-4992-9499-849d1973d0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d7f075-e983-4959-a61f-c885ace52845', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3633fe25-00ee-49e2-920c-44155828c56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:53 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c 1073741824 Jul 19 13:20:53 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:53 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume volume-93d7f075-e983-4959-a61f-c885ace52845 (93d7f075-e983-4959-a61f-c885ace52845): created successfully Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3633fe25-00ee-49e2-920c-44155828c56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (cdea2227-dfe1-477c-a453-fabce06675a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-09d9fb01-6d30-432a-bcba-93473d006b95 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created volume successfully. Jul 19 13:20:53 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c 1073741824" returned: 0 in 0.506s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:53 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c Jul 19 13:20:53 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:53 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c" returned: 0 in 0.281s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365fcadc-e0c4-4c34-9141-7526446c3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa24337-9ade-40e9-b949-77a95552708c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f37c08-4716-4288-b381-beacf129fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:53 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Volume volume-8fa24337-9ade-40e9-b949-77a95552708c (8fa24337-9ade-40e9-b949-77a95552708c): created successfully Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f37c08-4716-4288-b381-beacf129fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Flow 'volume_create_manager' (b55df603-7007-4573-99c7-8ad46becec51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-13fbfe8e-e9ab-4feb-ae91-bf3d943cb1da tempest-CinderUnicodeTest-1035457466 None] Created volume successfully. Jul 19 13:20:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Creating offline snapshot 6d844ff4-df7f-45cd-8b37-c3c168aac2dc of volume 93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:20:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50f1a7-4134-4f11-a7cd-f6be379376bc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:54 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 Jul 19 13:20:54 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:54 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:54 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc 1G Jul 19 13:20:54 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Flow 'volume_create_manager' (81d2500b-6119-4d47-9910-d7445b281f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e49704e-416c-49d0-9e0a-5e08b9aa6fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e49704e-416c-49d0-9e0a-5e08b9aa6fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db1afe-d078-4d9e-a0a5-36b246001e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66db8ab05e524bc3880cd8ecdf14d21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:55Z,use_quota=True,user_id='8bc8124b11f54c9f8d24c1033b2b803a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f659383b-c3e8-4eef-a1f6-5775c86e5eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f659383b-c3e8-4eef-a1f6-5775c86e5eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71f1d5d-2162-4f2a-9bc4-45864db3e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Flow 'volume_create_manager' (2ad9d9e4-23ae-4ebb-8860-c84b3e6bb8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9419c9f5-a106-4523-871a-77c26bb86d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9419c9f5-a106-4523-871a-77c26bb86d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1393134477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639dc9b9-26f6-4779-a688-2e8ddf781c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e40664b47324ca3ac5a3ed2ecde0b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:55Z,use_quota=True,user_id='2c9262888a544a9eb1cc33c1a80155a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abaaff0-2f7f-45c2-b866-d589d20c1f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abaaff0-2f7f-45c2-b866-d589d20c1f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b0619-ca9d-4570-b713-8d3c0a7309ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b0619-ca9d-4570-b713-8d3c0a7309ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639dc9b9-26f6-4779-a688-2e8ddf781c76', 'volume_name': 'volume-639dc9b9-26f6-4779-a688-2e8ddf781c76', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d9b26f-55bd-4dd8-ab40-18eef260ad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d9b26f-55bd-4dd8-ab40-18eef260ad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb85024-0d5a-4bb6-b05b-9aa0ee92662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Volume 639dc9b9-26f6-4779-a688-2e8ddf781c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639dc9b9-26f6-4779-a688-2e8ddf781c76', 'volume_size': 1} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc 1G" returned: 0 in 0.574s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d7f075-e983-4959-a61f-c885ace52845 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:55 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d7f075-e983-4959-a61f-c885ace52845 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc Jul 19 13:20:55 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71f1d5d-2162-4f2a-9bc4-45864db3e548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9db1afe-d078-4d9e-a0a5-36b246001e4e', 'volume_name': 'volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e', 'volume_size': 1, 'image_id': 'a76e3bae-594b-47c4-876b-041afa5b662b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a76e3bae-594b-47c4-876b-041afa5b662b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47fa95c689d696c418d76048b69b569d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66db8ab05e524bc3880cd8ecdf14d21c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd8a08f311cec5e7022f3a69afce9661e70d75f5e667ed8623cddecf2a1e01fc5ef448090fcf8deaa201f69dcf6ccd8825ad5e2c96c1bb786c18c6d2e9b0ee0f', 'id': 'a76e3bae-594b-47c4-876b-041afa5b662b', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a76e3bae-594b-47c4-876b-041afa5b662b/file', 'properties': {}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987df601-b71c-4d17-a2b2-3b2ec6563a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987df601-b71c-4d17-a2b2-3b2ec6563a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83976bd-43ae-4df3-895a-16c1a082e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:55 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Volume f9db1afe-d078-4d9e-a0a5-36b246001e4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e', 'volume_size': 1, 'image_id': 'a76e3bae-594b-47c4-876b-041afa5b662b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a76e3bae-594b-47c4-876b-041afa5b662b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47fa95c689d696c418d76048b69b569d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66db8ab05e524bc3880cd8ecdf14d21c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd8a08f311cec5e7022f3a69afce9661e70d75f5e667ed8623cddecf2a1e01fc5ef448090fcf8deaa201f69dcf6ccd8825ad5e2c96c1bb786c18c6d2e9b0ee0f', 'id': 'a76e3bae-594b-47c4-876b-041afa5b662b', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a76e3bae-594b-47c4-876b-041afa5b662b/file', 'properties': {}}, 'image_service': } Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Trying to clone f9db1afe-d078-4d9e-a0a5-36b246001e4e from image a76e3bae-594b-47c4-876b-041afa5b662b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a76e3bae-594b-47c4-876b-041afa5b662b', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:20:55 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Image download 0.00 MB at 0.00 MB/s Jul 19 13:20:55 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d7f075-e983-4959-a61f-c885ace52845 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc" returned: 0 in 0.319s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:55 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc is being set with open permissions: ugo+rw Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:55 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc Jul 19 13:20:55 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0f5697-fe85-4c6e-92a6-4fdcebc12588]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:55 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD Jul 19 13:20:55 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:55 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:55 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Flow 'volume_create_manager' (7b5ca3c5-4820-4947-8bf8-3fb7facc9d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77048f9f-bb1c-4579-b641-e111de2429b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc" returned: 0 in 0.344s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77048f9f-bb1c-4579-b641-e111de2429b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286c2f0f-6bab-4fd7-b039-33d0b69e8ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e731261f3e9f4fa8b6cab9827837ee8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:56Z,use_quota=True,user_id='ef39000d43974fac829d7598dfc3824c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98fe509e-de4a-42c0-98d7-5a4fab8c49ca),volume_type_id=98fe509e-de4a-42c0-98d7-5a4fab8c49ca)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4df3c1f-f940-4674-ba65-a0654761dfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4df3c1f-f940-4674-ba65-a0654761dfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1825468-ad1e-4d26-8a42-dd5681273d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.image.glance [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Creating Keystone auth plugin from conf {{(pid=87305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:56 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:56 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.info Jul 19 13:20:56 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:56 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD Jul 19 13:20:56 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1825468-ad1e-4d26-8a42-dd5681273d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '286c2f0f-6bab-4fd7-b039-33d0b69e8ac3', 'volume_name': 'volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3', 'volume_size': 1, 'image_id': 'b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13c8802e78ac29a26965422faec9ef3b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e731261f3e9f4fa8b6cab9827837ee8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f79fc1cfc32bbc5470cc42dad8b6811e94737b25f1687bf4daf363ffa473c1e037cbaf4f5bb302e69a360a6687f2ac7f642a2dc84c97cc0d0b07ee9781a3b941', 'id': 'b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc0d137-a37b-4716-a45d-2acd3129622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc0d137-a37b-4716-a45d-2acd3129622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c678e38-c7c5-42b2-b62d-1a4beb931280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:56 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Volume 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3', 'volume_size': 1, 'image_id': 'b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13c8802e78ac29a26965422faec9ef3b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e731261f3e9f4fa8b6cab9827837ee8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f79fc1cfc32bbc5470cc42dad8b6811e94737b25f1687bf4daf363ffa473c1e037cbaf4f5bb302e69a360a6687f2ac7f642a2dc84c97cc0d0b07ee9781a3b941', 'id': 'b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Trying to clone 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 from image b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'metadata': {}}]). {{(pid=87305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 13:20:56 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.info" returned: 0 in 0.304s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:56 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.info is being set with open permissions: ugo+rw Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:56 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.info Jul 19 13:20:56 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 13:20:56 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Image download 0.00 MB at 0.00 MB/s Jul 19 13:20:56 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Temporary image a76e3bae-594b-47c4-876b-041afa5b662b is fetched for user 8bc8124b11f54c9f8d24c1033b2b803a. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba91b0-9193-4cc0-a8ac-f6c3bb9c9aa4]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[874e50ca-7efb-4611-a656-2af162fc8923]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:56 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD Jul 19 13:20:56 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:56 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.info" returned: 0 in 0.267s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1393134477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639dc9b9-26f6-4779-a688-2e8ddf781c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e40664b47324ca3ac5a3ed2ecde0b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:55Z,use_quota=True,user_id='2c9262888a544a9eb1cc33c1a80155a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Creating volume 639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:56 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:56 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD Jul 19 13:20:56 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:56 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 1073741824 Jul 19 13:20:56 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:56 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-32db8b82-2f6c-4390-8197-4fca462ae315 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Create snapshot completed successfully Jul 19 13:20:56 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:56 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:57 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD Jul 19 13:20:57 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:57 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD Jul 19 13:20:57 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:57 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 1073741824" returned: 0 in 0.490s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:57 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Temporary image b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 is fetched for user ef39000d43974fac829d7598dfc3824c. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 13:20:57 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 Jul 19 13:20:57 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b5756a-f86e-4c16-bcc8-3f9c2bca1c46]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:57 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:57 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD Jul 19 13:20:57 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:57 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db1afe-d078-4d9e-a0a5-36b246001e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66db8ab05e524bc3880cd8ecdf14d21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:55Z,use_quota=True,user_id='8bc8124b11f54c9f8d24c1033b2b803a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Creating volume f9db1afe-d078-4d9e-a0a5-36b246001e4e {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:57 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:57 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e 1073741824 Jul 19 13:20:57 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb85024-0d5a-4bb6-b05b-9aa0ee92662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639dc9b9-26f6-4779-a688-2e8ddf781c76', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e48c8c9-f88c-417f-b746-25a37624f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:57 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Volume volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 (639dc9b9-26f6-4779-a688-2e8ddf781c76): created successfully Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e48c8c9-f88c-417f-b746-25a37624f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Flow 'volume_create_manager' (2ad9d9e4-23ae-4ebb-8860-c84b3e6bb8f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-afcdd486-5cb9-4d4b-b374-fc51aee63100 tempest-CinderUnicodeTest-1035457466 None] Created volume successfully. Jul 19 13:20:57 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:57 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD Jul 19 13:20:57 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (e14ac6e2-0052-4232-8fe7-6f5b4d9ff3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fda610a-dc80-46a1-a176-c3e87896ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fda610a-dc80-46a1-a176-c3e87896ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182687029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b01d8-1c0c-4298-b80d-501f1d7070c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:58Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e4d75e-740f-494d-85ae-b7deebd94140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e4d75e-740f-494d-85ae-b7deebd94140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666a0cb6-b221-486a-a416-a3f15d12f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666a0cb6-b221-486a-a416-a3f15d12f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7b01d8-1c0c-4298-b80d-501f1d7070c7', 'volume_name': 'volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8489a18-1165-4a46-b0fe-193c40bf90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8489a18-1165-4a46-b0fe-193c40bf90e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a35a46d-6de5-470b-8730-f2540bec87c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume 9b7b01d8-1c0c-4298-b80d-501f1d7070c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7', 'volume_size': 1} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e 1073741824" returned: 0 in 0.614s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:58 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e Jul 19 13:20:58 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (daef29d3-f9d8-497a-b9d7-e2fa9471a00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b918dc6-1194-4194-9913-c55e36e4e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b918dc6-1194-4194-9913-c55e36e4e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223708570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1453b3fe-79ca-4502-88e4-bf8b7b13ece6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:58Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a672eb3c-7588-4f27-9eb8-b72925382bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a672eb3c-7588-4f27-9eb8-b72925382bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e3e315-ddee-4e9b-9824-c908a8ae0ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e3e315-ddee-4e9b-9824-c908a8ae0ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1453b3fe-79ca-4502-88e4-bf8b7b13ece6', 'volume_name': 'volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad49aca-98d6-4fce-9310-0196361e00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad49aca-98d6-4fce-9310-0196361e00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415c65d4-443b-4bdf-8b2d-5c84d130ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume 1453b3fe-79ca-4502-88e4-bf8b7b13ece6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6', 'volume_size': 1} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e" returned: 0 in 0.381s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286c2f0f-6bab-4fd7-b039-33d0b69e8ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e731261f3e9f4fa8b6cab9827837ee8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:56Z,use_quota=True,user_id='ef39000d43974fac829d7598dfc3824c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98fe509e-de4a-42c0-98d7-5a4fab8c49ca),volume_type_id=98fe509e-de4a-42c0-98d7-5a4fab8c49ca)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Creating volume 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:58 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:58 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 1073741824 Jul 19 13:20:58 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Attempting download of a76e3bae-594b-47c4-876b-041afa5b662b ((None, [{'url': 'file:///opt/stack/data/glance/images/a76e3bae-594b-47c4-876b-041afa5b662b', 'metadata': {}}])) to volume f9db1afe-d078-4d9e-a0a5-36b246001e4e. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6262ea9d-c618-4449-becc-ebdc1a103fdb]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a76e3bae-594b-47c4-876b-041afa5b662b_3d58n7ag {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:58 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a76e3bae-594b-47c4-876b-041afa5b662b_3d58n7ag Jul 19 13:20:58 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (b8b11129-6abb-4a4b-8959-497e32c64e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9030e1-1148-474d-bfa9-c4b563688e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9030e1-1148-474d-bfa9-c4b563688e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786388594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129e85ca-7927-47e4-a5d2-3ad511e27ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:59Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49faf73d-faf7-4b02-ad11-c6acd522560f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49faf73d-faf7-4b02-ad11-c6acd522560f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99432e3-9286-486e-93d8-1962485a651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99432e3-9286-486e-93d8-1962485a651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129e85ca-7927-47e4-a5d2-3ad511e27ff1', 'volume_name': 'volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e959f6-b92b-4fc0-aef5-39422d1ede98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e959f6-b92b-4fc0-aef5-39422d1ede98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907a7c2d-5f50-4201-9a96-904b108bdc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume 129e85ca-7927-47e4-a5d2-3ad511e27ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1', 'volume_size': 1} Jul 19 13:20:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:59 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a76e3bae-594b-47c4-876b-041afa5b662b_3d58n7ag" returned: 0 in 0.410s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a76e3bae-594b-47c4-876b-041afa5b662b_3d58n7ag {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:59 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 1073741824" returned: 0 in 0.568s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:59 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 Jul 19 13:20:59 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:59 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a76e3bae-594b-47c4-876b-041afa5b662b_3d58n7ag Jul 19 13:20:59 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (f2558c1e-b07e-4c27-a9bb-a71bc3caeb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078923e-21dc-4865-ac15-c03e26df8c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078923e-21dc-4865-ac15-c03e26df8c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1254877571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db250eb5-7c42-4fcd-a591-0dabe60e9987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:59Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e423fb2c-f613-44da-93b6-066e3e5a5ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e423fb2c-f613-44da-93b6-066e3e5a5ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86a4547-40f1-4e67-b4aa-07b07663e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86a4547-40f1-4e67-b4aa-07b07663e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db250eb5-7c42-4fcd-a591-0dabe60e9987', 'volume_name': 'volume-db250eb5-7c42-4fcd-a591-0dabe60e9987', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb418cf1-909c-4594-b319-6e346cea8ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb418cf1-909c-4594-b319-6e346cea8ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52beddb-93c6-47d8-a4a8-cdeebc5d3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume db250eb5-7c42-4fcd-a591-0dabe60e9987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db250eb5-7c42-4fcd-a591-0dabe60e9987', 'volume_size': 1} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:59 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:59 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182687029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b01d8-1c0c-4298-b80d-501f1d7070c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:58Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Creating volume 9b7b01d8-1c0c-4298-b80d-501f1d7070c7 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:20:59 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a76e3bae-594b-47c4-876b-041afa5b662b_3d58n7ag" returned: 1 in 0.451s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a76e3bae-594b-47c4-876b-041afa5b662b_3d58n7ag' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f86089c-5f9f-4f3d-b5bf-6bcd0830f573]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:59 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 1073741824 Jul 19 13:20:59 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Attempting download of b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'metadata': {}}])) to volume 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[226c4e65-124a-435b-b2b6-fbcf8d99ff04]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_tv5eqtnv {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (69501e32-6fdd-4221-a84f-b4942a41787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:20:59 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD Jul 19 13:20:59 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f24552-16b3-45d2-8abe-dbb73e400efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f24552-16b3-45d2-8abe-dbb73e400efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-860398715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16de2489-6c8c-4703-910d-efa27247b7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:00Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4a7426-6df1-44bb-8946-b964e7f8e486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4a7426-6df1-44bb-8946-b964e7f8e486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab87fd71-0bc4-4a9d-86af-115154c9d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab87fd71-0bc4-4a9d-86af-115154c9d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16de2489-6c8c-4703-910d-efa27247b7ba', 'volume_name': 'volume-16de2489-6c8c-4703-910d-efa27247b7ba', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77eee30d-f05c-49c3-9413-d64be6cb491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77eee30d-f05c-49c3-9413-d64be6cb491f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6b9202-dfd8-4869-9b8d-4b1ca6ed6db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:20:59 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume 16de2489-6c8c-4703-910d-efa27247b7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16de2489-6c8c-4703-910d-efa27247b7ba', 'volume_size': 1} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:20:59 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_tv5eqtnv Jul 19 13:20:59 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:20:59 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:20:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:20:59 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 1073741824" returned: 0 in 0.478s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_tv5eqtnv" returned: 0 in 0.381s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_tv5eqtnv {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD Jul 19 13:21:00 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 Jul 19 13:21:00 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_tv5eqtnv Jul 19 13:21:00 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] a76e3bae-594b-47c4-876b-041afa5b662b was raw, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e Jul 19 13:21:00 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.781s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223708570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1453b3fe-79ca-4502-88e4-bf8b7b13ece6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:58Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Creating volume 1453b3fe-79ca-4502-88e4-bf8b7b13ece6 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:00 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a35a46d-6de5-470b-8730-f2540bec87c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:00 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 1073741824 Jul 19 13:21:00 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bcd61e-0455-473e-be99-23c2f6fb0a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:00 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 (9b7b01d8-1c0c-4298-b80d-501f1d7070c7): created successfully Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bcd61e-0455-473e-be99-23c2f6fb0a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:00 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (e14ac6e2-0052-4232-8fe7-6f5b4d9ff3a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_tv5eqtnv" returned: 1 in 0.372s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_tv5eqtnv' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52d078-3973-4d20-bb40-2fecd243567b]: (4, 'raw') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-40730373-0f17-4dcb-a813-85078efd5d97 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created volume successfully. Jul 19 13:21:00 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD Jul 19 13:21:00 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e" returned: 0 in 0.490s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a76e3bae-594b-47c4-876b-041afa5b662b_z7l0vnuqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:21:00 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 1073741824" returned: 0 in 0.446s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e 1G Jul 19 13:21:00 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:00 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 Jul 19 13:21:00 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:00 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD Jul 19 13:21:00 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:01 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6" returned: 0 in 0.280s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.549s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:01 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415c65d4-443b-4bdf-8b2d-5c84d130ca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772a9a2d-dc9f-4e32-93c0-3e5a073428bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:01 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e 1G" returned: 0 in 0.384s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Downloaded image a76e3bae-594b-47c4-876b-041afa5b662b ((None, [{'url': 'file:///opt/stack/data/glance/images/a76e3bae-594b-47c4-876b-041afa5b662b', 'metadata': {}}])) to volume f9db1afe-d078-4d9e-a0a5-36b246001e4e successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Temporary image a76e3bae-594b-47c4-876b-041afa5b662b for user 8bc8124b11f54c9f8d24c1033b2b803a is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Marking volume f9db1afe-d078-4d9e-a0a5-36b246001e4e as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Creating offline snapshot d9cccb13-ee39-4085-961c-fe7a14f7d864 of volume 639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 was raw, converting to qcow2 {{(pid=87305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6542119-85f6-4395-ac4c-fb1aa87fb819]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:01 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 (1453b3fe-79ca-4502-88e4-bf8b7b13ece6): created successfully Jul 19 13:21:01 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 Jul 19 13:21:01 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772a9a2d-dc9f-4e32-93c0-3e5a073428bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (daef29d3-f9d8-497a-b9d7-e2fa9471a00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Copying metadata from image a76e3bae-594b-47c4-876b-041afa5b662b to f9db1afe-d078-4d9e-a0a5-36b246001e4e. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Creating volume glance metadata for volume f9db1afe-d078-4d9e-a0a5-36b246001e4e backed by image a76e3bae-594b-47c4-876b-041afa5b662b with: {'image_id': 'a76e3bae-594b-47c4-876b-041afa5b662b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '47fa95c689d696c418d76048b69b569d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:21:01 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-00e10768-6b87-4290-b237-bc892e07a85f tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created volume successfully. Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83976bd-43ae-4df3-895a-16c1a082e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e', 'volume_size': 1, 'image_id': 'a76e3bae-594b-47c4-876b-041afa5b662b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a76e3bae-594b-47c4-876b-041afa5b662b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47fa95c689d696c418d76048b69b569d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66db8ab05e524bc3880cd8ecdf14d21c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd8a08f311cec5e7022f3a69afce9661e70d75f5e667ed8623cddecf2a1e01fc5ef448090fcf8deaa201f69dcf6ccd8825ad5e2c96c1bb786c18c6d2e9b0ee0f', 'id': 'a76e3bae-594b-47c4-876b-041afa5b662b', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a76e3bae-594b-47c4-876b-041afa5b662b/file', 'properties': {}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79958cab-3ed4-429a-bd6d-01a4e731471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:01 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 Jul 19 13:21:01 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:01 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Volume volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e (f9db1afe-d078-4d9e-a0a5-36b246001e4e): created successfully Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79958cab-3ed4-429a-bd6d-01a4e731471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Flow 'volume_create_manager' (81d2500b-6119-4d47-9910-d7445b281f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:01 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6dcaf0fe-58ab-43ba-a452-f1cf1eb2cc44 tempest-VolumeImageDependencyTests-805272279 None] Created volume successfully. Jul 19 13:21:01 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:01 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 1G Jul 19 13:21:01 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:01 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3" returned: 0 in 0.498s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b6d83b97-6bc3-4e83-ada3-4be65bca7ef1_o1hcd2pidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:21:01 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:01 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 1G Jul 19 13:21:01 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:01 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 1G" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:02 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:02 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 1G" returned: 0 in 0.321s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Downloaded image b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'metadata': {}}])) to volume 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 successfully. {{(pid=87305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 13:21:02 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Temporary image b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 for user ef39000d43974fac829d7598dfc3824c is deleted. {{(pid=87305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.volume_utils [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Marking volume 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 as bootable. {{(pid=87305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Copying metadata from image b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 to 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3. {{(pid=87305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Creating volume glance metadata for volume 286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 backed by image b6d83b97-6bc3-4e83-ada3-4be65bca7ef1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '13c8802e78ac29a26965422faec9ef3b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c678e38-c7c5-42b2-b62d-1a4beb931280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3', 'volume_size': 1, 'image_id': 'b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13c8802e78ac29a26965422faec9ef3b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e731261f3e9f4fa8b6cab9827837ee8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f79fc1cfc32bbc5470cc42dad8b6811e94737b25f1687bf4daf363ffa473c1e037cbaf4f5bb302e69a360a6687f2ac7f642a2dc84c97cc0d0b07ee9781a3b941', 'id': 'b6d83b97-6bc3-4e83-ada3-4be65bca7ef1', 'created_at': datetime.datetime(2026, 7, 19, 11, 20, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 11, 20, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6d83b97-6bc3-4e83-ada3-4be65bca7ef1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871c601d-21ee-41b0-99a2-69ab1f47882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:02 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Volume volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 (286c2f0f-6bab-4fd7-b039-33d0b69e8ac3): created successfully Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871c601d-21ee-41b0-99a2-69ab1f47882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Flow 'volume_create_manager' (7b5ca3c5-4820-4947-8bf8-3fb7facc9d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:02 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1cb29b00-8063-4d07-904a-a6266b141882 tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Created volume successfully. Jul 19 13:21:02 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:02 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 is being set with open permissions: ugo+rw Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Acquiring lock "cinder-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:02 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 Jul 19 13:21:02 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "cinder-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Acquiring lock "cinder-quobyte-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "cinder-quobyte-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a6f98-b749-4a4b-8fcb-ad3d88165de7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:02 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Acquiring lock "cinder-f9db1afe-d078-4d9e-a0a5-36b246001e4e-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864" returned: 0 in 0.268s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:02 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 Jul 19 13:21:02 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Lock "cinder-f9db1afe-d078-4d9e-a0a5-36b246001e4e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Acquiring lock "cinder-quobyte-f9db1afe-d078-4d9e-a0a5-36b246001e4e" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:02 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.info Jul 19 13:21:02 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Lock "cinder-quobyte-f9db1afe-d078-4d9e-a0a5-36b246001e4e" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ef738-352d-46dc-a499-6e1627196afc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:02 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e Jul 19 13:21:02 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:02 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3" returned: 0 in 0.422s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:02 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.info" returned: 0 in 0.275s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:02 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.info is being set with open permissions: ugo+rw Jul 19 13:21:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:02 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3 Jul 19 13:21:02 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:02 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.info Jul 19 13:21:02 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:03 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:03 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e Jul 19 13:21:03 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:03 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:03 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.info" returned: 0 in 0.260s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "cinder-quobyte-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3" released by "delete_volume" :: held 0.747s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.246s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786388594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129e85ca-7927-47e4-a5d2-3ad511e27ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:59Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Creating volume 129e85ca-7927-47e4-a5d2-3ad511e27ff1 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:03 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:03 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 1073741824 Jul 19 13:21:03 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8e7ac64f-e04f-46e2-aa44-65015c5d3cbc tempest-CinderUnicodeTest-1035457466 None] Create snapshot completed successfully Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Created reservations ['ca70e635-509b-443d-88c7-9eea32db4089', '932e02ff-aabb-4e01-9560-5eb4e03dc719', 'd6ea418b-99dc-4834-9fca-8815a6db9be9', '09ead751-a8c3-4249-8e15-fe9e7c32a86b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:03 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:03 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:03 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-f9db1afe-d078-4d9e-a0a5-36b246001e4e" returned: 0 in 0.291s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Lock "cinder-quobyte-f9db1afe-d078-4d9e-a0a5-36b246001e4e" released by "delete_volume" :: held 0.723s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Created reservations ['04af67d0-10e4-4ec0-b16b-00f6cd3ff1df', '2fde7008-8d73-4b7c-8a30-dac28eac7bdf', '4f5ddd96-3b52-4ba3-882d-2dc4f927ff28', '1523077b-51fe-4740-b1b7-65bb86b3836f'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:03 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:03 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:03 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.366s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:03 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Deleted volume successfully. Jul 19 13:21:03 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 1073741824" returned: 0 in 0.557s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c41ab292-6ba9-416e-94b8-5c0290fc040e tempest-VolumeAndVolumeTypeFromImageTest-815707319 None] Lock "cinder-286c2f0f-6bab-4fd7-b039-33d0b69e8ac3-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "cinder-d9cccb13-ee39-4085-961c-fe7a14f7d864-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-d9cccb13-ee39-4085-961c-fe7a14f7d864-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "cinder-quobyte-639dc9b9-26f6-4779-a688-2e8ddf781c76" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:03 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 Jul 19 13:21:03 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-639dc9b9-26f6-4779-a688-2e8ddf781c76" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "cinder-quobyte-d9cccb13-ee39-4085-961c-fe7a14f7d864" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-d9cccb13-ee39-4085-961c-fe7a14f7d864" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Deleting offline snapshot d9cccb13-ee39-4085-961c-fe7a14f7d864 of volume 639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:03 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] snapshot_file for this snap is: volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.440s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:04 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Deleted volume successfully. Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0574a-f400-4fe1-8a09-74584e3ddba1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c193616e-ec1e-481e-b19e-d21a8ccf6e8f tempest-VolumeImageDependencyTests-805272279 None] Lock "cinder-f9db1afe-d078-4d9e-a0a5-36b246001e4e-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:04 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 Jul 19 13:21:04 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:04 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1" returned: 0 in 0.298s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.862s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1254877571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db250eb5-7c42-4fcd-a591-0dabe60e9987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:20:59Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Creating volume db250eb5-7c42-4fcd-a591-0dabe60e9987 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:04 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907a7c2d-5f50-4201-9a96-904b108bdc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a324196-e642-401a-a3da-3d65ce83b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:04 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 1073741824 Jul 19 13:21:04 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:04 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 (129e85ca-7927-47e4-a5d2-3ad511e27ff1): created successfully Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a324196-e642-401a-a3da-3d65ce83b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (b8b11129-6abb-4a4b-8959-497e32c64e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:04 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7264ca21-1cd6-42c0-9991-7ad8fbcd6ff9 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created volume successfully. Jul 19 13:21:04 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864" returned: 0 in 0.465s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-639dc9b9-26f6-4779-a688-2e8ddf781c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc7086-c754-473b-8922-0a6c3be2c3ac]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:04 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 Jul 19 13:21:04 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:04 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 1073741824" returned: 0 in 0.623s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:04 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 Jul 19 13:21:04 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:05 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76" returned: 0 in 0.506s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:05 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 Jul 19 13:21:05 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:05 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.544s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-860398715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16de2489-6c8c-4703-910d-efa27247b7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fc4eda32684c5eaef845a3de8be50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:00Z,use_quota=True,user_id='84ac8d1348af435ca41bd6b7fc27a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Creating volume 16de2489-6c8c-4703-910d-efa27247b7ba {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:05 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:05 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba 1073741824 Jul 19 13:21:05 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52beddb-93c6-47d8-a4a8-cdeebc5d3e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db250eb5-7c42-4fcd-a591-0dabe60e9987', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a4d101-e781-4dad-9060-dbbeb5bcb4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:05 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 (db250eb5-7c42-4fcd-a591-0dabe60e9987): created successfully Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a4d101-e781-4dad-9060-dbbeb5bcb4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (f2558c1e-b07e-4c27-a9bb-a71bc3caeb04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:05 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-61a7647b-953f-478f-8cf0-91647e47752b tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created volume successfully. Jul 19 13:21:05 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864" returned: 0 in 0.467s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:05 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864 Jul 19 13:21:05 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:05 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76.d9cccb13-ee39-4085-961c-fe7a14f7d864" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:05 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba 1073741824" returned: 0 in 0.631s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-d9cccb13-ee39-4085-961c-fe7a14f7d864" released by "_delete_snapshot" :: held 1.992s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-639dc9b9-26f6-4779-a688-2e8ddf781c76" released by "delete_snapshot" :: held 2.043s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:06 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba Jul 19 13:21:06 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Created reservations ['f7157217-195d-425a-8485-6019c2256f9a', 'c856bb0d-1841-49d1-8bd1-99102fc9d62a', '2dcb4fa0-d339-44da-aae7-546cf8c1ddb9', '7cebbe49-b1d9-4817-9f58-fa9d8050cc53'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Delete snapshot completed successfully. Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-8120d16f-eb08-4d94-b7e0-082206f6d031 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-d9cccb13-ee39-4085-961c-fe7a14f7d864-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:06 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba" returned: 0 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6b9202-dfd8-4869-9b8d-4b1ca6ed6db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16de2489-6c8c-4703-910d-efa27247b7ba', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07600fe-8479-4ff6-ac90-53598d1d73cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:06 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Volume volume-16de2489-6c8c-4703-910d-efa27247b7ba (16de2489-6c8c-4703-910d-efa27247b7ba): created successfully Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07600fe-8479-4ff6-ac90-53598d1d73cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:06 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Flow 'volume_create_manager' (69501e32-6fdd-4221-a84f-b4942a41787a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6d144b5b-8024-47bf-a963-1c8805c05826 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created volume successfully. Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "cinder-639dc9b9-26f6-4779-a688-2e8ddf781c76-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-639dc9b9-26f6-4779-a688-2e8ddf781c76-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "cinder-quobyte-639dc9b9-26f6-4779-a688-2e8ddf781c76" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-639dc9b9-26f6-4779-a688-2e8ddf781c76" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa96c7-6172-434f-b446-fd368e0eafa5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:07 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 Jul 19 13:21:07 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-16de2489-6c8c-4703-910d-efa27247b7ba-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-16de2489-6c8c-4703-910d-efa27247b7ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-16de2489-6c8c-4703-910d-efa27247b7ba" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:07 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76" returned: 0 in 0.466s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-16de2489-6c8c-4703-910d-efa27247b7ba" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:07 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76 Jul 19 13:21:07 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef9c2e2-0172-4662-959d-ec74c96275b1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:07 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba Jul 19 13:21:07 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:07 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-639dc9b9-26f6-4779-a688-2e8ddf781c76" returned: 0 in 0.331s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-639dc9b9-26f6-4779-a688-2e8ddf781c76" released by "delete_volume" :: held 0.882s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Created reservations ['efe2afae-dd05-4b5e-a0d2-f36f4bbca889', 'e2777ec1-b8aa-4b35-a20c-841ea91169a1', 'a2a8673c-6769-40f8-b993-a10406eed20b', '1cf70bf2-6b42-4431-b7e3-c8d177881de6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:08 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba" returned: 0 in 0.497s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:08 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:08 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:08 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba Jul 19 13:21:08 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "cinder-8fa24337-9ade-40e9-b949-77a95552708c-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-8fa24337-9ade-40e9-b949-77a95552708c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "cinder-quobyte-8fa24337-9ade-40e9-b949-77a95552708c" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-8fa24337-9ade-40e9-b949-77a95552708c" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd956bb-ef4f-4f55-9303-2af7a35278e9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:08 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c Jul 19 13:21:08 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:08 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-16de2489-6c8c-4703-910d-efa27247b7ba" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-16de2489-6c8c-4703-910d-efa27247b7ba" released by "delete_volume" :: held 0.936s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:08 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.450s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Deleted volume successfully. Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-a6147ae1-10e0-4eae-a9ab-a272c1829de4 tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-639dc9b9-26f6-4779-a688-2e8ddf781c76-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created reservations ['c6496f32-b492-444b-8917-81dc2f7c5fb8', '67048a05-b07e-4d77-9b0f-15c9c8d1354c', '3cc4b02b-bbb0-4482-a117-964ad2829e99', '3a644129-0a18-4fc6-b14a-8688c7040d9d'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:08 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:08 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:08 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c" returned: 0 in 0.554s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-db250eb5-7c42-4fcd-a591-0dabe60e9987-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:09 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c Jul 19 13:21:09 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-db250eb5-7c42-4fcd-a591-0dabe60e9987-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (305682c1-dea5-41b4-97fa-22268e4afba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5a1716-0320-4d61-a731-c4c0641fac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5a1716-0320-4d61-a731-c4c0641fac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999843680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9156c307-de47-458a-96fd-2a102fdd8bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:09Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71e143d-b66a-4f3b-b6b5-062182b9a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71e143d-b66a-4f3b-b6b5-062182b9a986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33fcfbe-688a-473a-b9ac-226113e3bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33fcfbe-688a-473a-b9ac-226113e3bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9156c307-de47-458a-96fd-2a102fdd8bf3', 'volume_name': 'volume-9156c307-de47-458a-96fd-2a102fdd8bf3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d01631-df5e-4b26-abd8-573171ae87f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d01631-df5e-4b26-abd8-573171ae87f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2238fe67-c9f7-455b-8c3b-e5d9b448cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Volume 9156c307-de47-458a-96fd-2a102fdd8bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9156c307-de47-458a-96fd-2a102fdd8bf3', 'volume_size': 1} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999843680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9156c307-de47-458a-96fd-2a102fdd8bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:09Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Creating volume 9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:09 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-db250eb5-7c42-4fcd-a591-0dabe60e9987" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:09 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.402s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:09 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 1073741824 Jul 19 13:21:09 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-db250eb5-7c42-4fcd-a591-0dabe60e9987" acquired by "delete_volume" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:09 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Deleted volume successfully. Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8afff24-9d2a-4b4a-8f32-5f3c3417123a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-42472a8b-08b8-42da-9360-a264d494c373 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-16de2489-6c8c-4703-910d-efa27247b7ba-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:09 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8fa24337-9ade-40e9-b949-77a95552708c" returned: 0 in 0.455s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-quobyte-8fa24337-9ade-40e9-b949-77a95552708c" released by "delete_volume" :: held 1.078s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:09 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 Jul 19 13:21:09 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (06c3b058-68f6-4708-9948-34367305f912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba66ea2-1878-4b1f-8e9d-32e116e50c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba66ea2-1878-4b1f-8e9d-32e116e50c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567019019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a50ead5-847f-4835-9afd-ea5deed3e500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:09Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d163b129-cdb3-4026-8656-7f1ace0e7f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d163b129-cdb3-4026-8656-7f1ace0e7f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ca31da-4a4c-4e36-9475-3cc1f46af631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ca31da-4a4c-4e36-9475-3cc1f46af631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a50ead5-847f-4835-9afd-ea5deed3e500', 'volume_name': 'volume-0a50ead5-847f-4835-9afd-ea5deed3e500', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1e937d-ed51-48f2-9d6a-d2a1fb6ae953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1e937d-ed51-48f2-9d6a-d2a1fb6ae953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f490a-a9e8-4955-9185-64fa59227502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:09 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Volume 0a50ead5-847f-4835-9afd-ea5deed3e500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a50ead5-847f-4835-9afd-ea5deed3e500', 'volume_size': 1} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Created reservations ['dbb1bc0b-e7e8-436f-9d99-0c08b915cb39', '196d3e97-0671-4401-b048-4c3c6e999c1c', '0bc96289-df6f-4685-ae3a-8fdd1124e7c5', '48a1d449-ae69-4e19-badf-36c976a218b0'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:09 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:09 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:09 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 1073741824" returned: 0 in 0.631s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:09 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987" returned: 0 in 0.552s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:09 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987 Jul 19 13:21:09 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:09 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 Jul 19 13:21:09 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:09 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (cd28a742-570e-4641-a2b2-d449f3b1ec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b885bd-da4a-4dcd-93bd-d28e8fb16965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b885bd-da4a-4dcd-93bd-d28e8fb16965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854588049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e12316c-ac1d-4ee6-b77e-023abeb23b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:10Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37773043-3443-4b63-88af-977acee3082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37773043-3443-4b63-88af-977acee3082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6964e4c2-cdb1-400b-890e-b3e7dfb68d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6964e4c2-cdb1-400b-890e-b3e7dfb68d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e12316c-ac1d-4ee6-b77e-023abeb23b20', 'volume_name': 'volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55b435f-5f44-477c-92bf-8378aa4a11cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55b435f-5f44-477c-92bf-8378aa4a11cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd240a57-17e6-42c4-b538-655ed1946d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Volume 0e12316c-ac1d-4ee6-b77e-023abeb23b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20', 'volume_size': 1} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.410s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:10 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Deleted volume successfully. Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-26d215f8-c3ef-4561-8a97-b68f0e8e5f0d tempest-CinderUnicodeTest-1035457466 None] Lock "cinder-8fa24337-9ade-40e9-b949-77a95552708c-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:10 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-db250eb5-7c42-4fcd-a591-0dabe60e9987" returned: 0 in 0.403s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-db250eb5-7c42-4fcd-a591-0dabe60e9987" released by "delete_volume" :: held 1.026s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:10 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3" returned: 0 in 0.409s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567019019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a50ead5-847f-4835-9afd-ea5deed3e500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:09Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Creating volume 0a50ead5-847f-4835-9afd-ea5deed3e500 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:10 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2238fe67-c9f7-455b-8c3b-e5d9b448cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9156c307-de47-458a-96fd-2a102fdd8bf3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156752eb-f213-4933-a388-6c1098104c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 1073741824 Jul 19 13:21:10 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Volume volume-9156c307-de47-458a-96fd-2a102fdd8bf3 (9156c307-de47-458a-96fd-2a102fdd8bf3): created successfully Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156752eb-f213-4933-a388-6c1098104c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (305682c1-dea5-41b4-97fa-22268e4afba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created reservations ['fb04ee7d-7e05-47f1-8247-e1242c3ad1b8', '8b23bc09-3533-49fa-a30e-7938aa0e3a4a', '9454b489-755e-4c6a-9def-e59d874257e2', '1617f42c-f932-42e3-a7e7-d6616d71332e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:10 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a8481177-e6e2-4ab7-9ae4-61d7c8fc01c8 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (4750650b-bf4b-42b8-90c6-fccac0ddffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f52b985-c86f-4475-a7e2-8b22dabf3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f52b985-c86f-4475-a7e2-8b22dabf3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1063710900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976ca92-14ae-4da9-ba1c-68e4c73c93c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:10Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840e1e85-3f06-4f00-badf-858d9fe05d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840e1e85-3f06-4f00-badf-858d9fe05d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae1d3d0-e329-4fea-bd85-000dc950eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae1d3d0-e329-4fea-bd85-000dc950eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd976ca92-14ae-4da9-ba1c-68e4c73c93c1', 'volume_name': 'volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716572ce-5e9c-46a2-8117-84d874f4598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716572ce-5e9c-46a2-8117-84d874f4598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b205b3-52fa-477c-9605-3420e36d8fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:10 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Volume d976ca92-14ae-4da9-ba1c-68e4c73c93c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1', 'volume_size': 1} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:10 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:10 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:10 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 1073741824" returned: 0 in 0.585s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (e1109833-f0a9-4199-9770-346140dfdb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:10 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b32625a-a863-4a20-aba9-3aab046d9d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b32625a-a863-4a20-aba9-3aab046d9d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225274958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cfceea-cf70-479f-b993-63fa730639cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:11Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2081d91c-851e-4418-81ac-c4f29032f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2081d91c-851e-4418-81ac-c4f29032f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b75569e-eded-45fb-8fc1-c61c2daf8aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b75569e-eded-45fb-8fc1-c61c2daf8aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72cfceea-cf70-479f-b993-63fa730639cd', 'volume_name': 'volume-72cfceea-cf70-479f-b993-63fa730639cd', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31af3259-3afb-428f-a01b-a29fec2196c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31af3259-3afb-428f-a01b-a29fec2196c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aec252-dc16-402e-922b-697bdb6e8390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Volume 72cfceea-cf70-479f-b993-63fa730639cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72cfceea-cf70-479f-b993-63fa730639cd', 'volume_size': 1} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:11 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.434s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Deleted volume successfully. Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-496ffe1c-e27a-433f-aaf3-f2f6d1a07cd2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-db250eb5-7c42-4fcd-a591-0dabe60e9987-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:11 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 Jul 19 13:21:11 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-129e85ca-7927-47e4-a5d2-3ad511e27ff1-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-129e85ca-7927-47e4-a5d2-3ad511e27ff1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-129e85ca-7927-47e4-a5d2-3ad511e27ff1" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-129e85ca-7927-47e4-a5d2-3ad511e27ff1" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:11 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fd337-291e-492e-b937-c5567cda271a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500" returned: 0 in 0.444s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854588049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e12316c-ac1d-4ee6-b77e-023abeb23b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:10Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Creating volume 0e12316c-ac1d-4ee6-b77e-023abeb23b20 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:11 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:11 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 1073741824 Jul 19 13:21:11 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f490a-a9e8-4955-9185-64fa59227502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a50ead5-847f-4835-9afd-ea5deed3e500', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe7d275-7b3f-406a-a078-77c9db7bfc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Volume volume-0a50ead5-847f-4835-9afd-ea5deed3e500 (0a50ead5-847f-4835-9afd-ea5deed3e500): created successfully Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe7d275-7b3f-406a-a078-77c9db7bfc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (06c3b058-68f6-4708-9948-34367305f912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (28f357fe-9259-407e-803b-73bfb463ba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:11 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 Jul 19 13:21:11 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1756d4b-aa94-413b-80dd-89c0354dee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a8f16f46-af93-45bd-a8ef-f978d9a32ba9 tempest-CreateVolumesFromImageTest-1930889840 None] Created volume successfully. Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1756d4b-aa94-413b-80dd-89c0354dee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210088964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5425010-6a52-4594-9857-2139bfd4220c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:12Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700683f3-6af3-40ed-8b5d-989df27d0b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700683f3-6af3-40ed-8b5d-989df27d0b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c480286-9960-436f-a583-b1bd1eb1f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c480286-9960-436f-a583-b1bd1eb1f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5425010-6a52-4594-9857-2139bfd4220c', 'volume_name': 'volume-e5425010-6a52-4594-9857-2139bfd4220c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ed0be5-fd42-4d2a-a5b1-377ca3ce71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ed0be5-fd42-4d2a-a5b1-377ca3ce71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df9188b-08cc-4e01-b5fc-dff068684497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:11 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Volume e5425010-6a52-4594-9857-2139bfd4220c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5425010-6a52-4594-9857-2139bfd4220c', 'volume_size': 1} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:12 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1" returned: 0 in 0.565s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:12 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1 Jul 19 13:21:12 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:12 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 1073741824" returned: 0 in 0.583s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:12 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 Jul 19 13:21:12 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:12 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-129e85ca-7927-47e4-a5d2-3ad511e27ff1" returned: 0 in 0.329s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-129e85ca-7927-47e4-a5d2-3ad511e27ff1" released by "delete_volume" :: held 0.956s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created reservations ['6c225caa-480d-4627-8157-77663f61c44d', '1bf9ff16-8aaa-437c-8b53-1c1f96b2c2b5', '90668a26-cb56-4737-9fce-9a33f3b3abb1', '52691811-23ac-4e4e-bb17-194873caac81'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:12 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20" returned: 0 in 0.305s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1063710900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976ca92-14ae-4da9-ba1c-68e4c73c93c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:10Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Creating volume d976ca92-14ae-4da9-ba1c-68e4c73c93c1 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:12 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:12 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 1073741824 Jul 19 13:21:12 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd240a57-17e6-42c4-b538-655ed1946d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848dfc63-ad3d-41d9-8654-7f33817424fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:12 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Volume volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 (0e12316c-ac1d-4ee6-b77e-023abeb23b20): created successfully Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848dfc63-ad3d-41d9-8654-7f33817424fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (cd28a742-570e-4641-a2b2-d449f3b1ec46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c2f3ff41-aaad-45f1-9b7d-51c5607ff70b tempest-CreateVolumesFromImageTest-1930889840 None] Created volume successfully. Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:12 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:12 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:12 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.270s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:12 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Deleted volume successfully. Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5da43158-1ec1-49b7-af4a-70ec3ed1f3c1 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-129e85ca-7927-47e4-a5d2-3ad511e27ff1-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:13 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 1073741824" returned: 0 in 0.481s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:13 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 Jul 19 13:21:13 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:13 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1" returned: 0 in 0.248s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225274958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cfceea-cf70-479f-b993-63fa730639cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:11Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Creating volume 72cfceea-cf70-479f-b993-63fa730639cd {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:13 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:13 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd 1073741824 Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b205b3-52fa-477c-9605-3420e36d8fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:13 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f842e6-c8cd-4f5f-93d2-92fbb9674f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:13 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Volume volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 (d976ca92-14ae-4da9-ba1c-68e4c73c93c1): created successfully Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f842e6-c8cd-4f5f-93d2-92fbb9674f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (4750650b-bf4b-42b8-90c6-fccac0ddffc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e54ee54a-dff3-4eea-a60b-0786e01af135 tempest-CreateVolumesFromImageTest-1930889840 None] Created volume successfully. Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-1453b3fe-79ca-4502-88e4-bf8b7b13ece6-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-1453b3fe-79ca-4502-88e4-bf8b7b13ece6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-1453b3fe-79ca-4502-88e4-bf8b7b13ece6" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-1453b3fe-79ca-4502-88e4-bf8b7b13ece6" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91bf696-1db9-4507-b4f0-f5ab4ebc9b97]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:13 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd 1073741824" returned: 0 in 0.537s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:13 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 Jul 19 13:21:13 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:13 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd Jul 19 13:21:13 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:14 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd" returned: 0 in 0.258s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.301s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210088964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5425010-6a52-4594-9857-2139bfd4220c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8da6f14fdbf48ecab02f3f74ebe6af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:12Z,use_quota=True,user_id='0de621d299f54bc2a014926a9123b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Creating volume e5425010-6a52-4594-9857-2139bfd4220c {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:14 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:14 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6" returned: 0 in 0.435s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:14 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c 1073741824 Jul 19 13:21:14 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aec252-dc16-402e-922b-697bdb6e8390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72cfceea-cf70-479f-b993-63fa730639cd', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4199cb03-a993-4478-9612-af5dfa586284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:14 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6 Jul 19 13:21:14 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Volume volume-72cfceea-cf70-479f-b993-63fa730639cd (72cfceea-cf70-479f-b993-63fa730639cd): created successfully Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4199cb03-a993-4478-9612-af5dfa586284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (e1109833-f0a9-4199-9770-346140dfdb3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-eca89441-9546-4c19-8b71-06b3576e31e3 tempest-CreateVolumesFromImageTest-1930889840 None] Created volume successfully. Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-be8da42b-c2b4-4e03-9f58-0eb54675e9f8 tempest-ProjectAdminTests-999046335 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87305) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 19 13:21:14 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-1453b3fe-79ca-4502-88e4-bf8b7b13ece6" returned: 0 in 0.303s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-1453b3fe-79ca-4502-88e4-bf8b7b13ece6" released by "delete_volume" :: held 0.783s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created reservations ['fe9e44e8-505b-49a2-9a4a-c909f18859b2', 'fdcd455e-1055-41b6-9925-f6646e5d9dc1', '67565386-1ef5-4328-ba5b-78fd8bd13f56', '1bd75c10-fcfc-4b05-b715-3a2651bb15da'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:14 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c 1073741824" returned: 0 in 0.515s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:14 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:14 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:14 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c Jul 19 13:21:14 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-9b7b01d8-1c0c-4298-b80d-501f1d7070c7-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-9b7b01d8-1c0c-4298-b80d-501f1d7070c7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-9b7b01d8-1c0c-4298-b80d-501f1d7070c7" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.323s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:15 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-9b7b01d8-1c0c-4298-b80d-501f1d7070c7" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Deleted volume successfully. Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357f778-5ff2-420b-8d60-706c994ab4f9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:15 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c" returned: 0 in 0.317s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0fd5b700-18b0-4da8-b764-ad8aa1ab380e tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-1453b3fe-79ca-4502-88e4-bf8b7b13ece6-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.203s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df9188b-08cc-4e01-b5fc-dff068684497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5425010-6a52-4594-9857-2139bfd4220c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e945a-9f9c-4ed1-8aba-4f2f2f4b96d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot 2f1061da-40c9-45d7-960f-2247c2533624 of volume 9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:15 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Volume volume-e5425010-6a52-4594-9857-2139bfd4220c (e5425010-6a52-4594-9857-2139bfd4220c): created successfully Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e945a-9f9c-4ed1-8aba-4f2f2f4b96d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Flow 'volume_create_manager' (28f357fe-9259-407e-803b-73bfb463ba0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80802e53-b474-4798-99cf-0dcc7057b46d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-72572046-c743-4e70-adb8-28f77643e00b tempest-CreateVolumesFromImageTest-1930889840 None] Created volume successfully. Jul 19 13:21:15 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 Jul 19 13:21:15 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:15 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 Jul 19 13:21:15 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:15 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7" returned: 0 in 0.431s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:15 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7 Jul 19 13:21:15 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:15 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3" returned: 0 in 0.428s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:15 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 1G Jul 19 13:21:15 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:15 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9b7b01d8-1c0c-4298-b80d-501f1d7070c7" returned: 0 in 0.304s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-9b7b01d8-1c0c-4298-b80d-501f1d7070c7" released by "delete_volume" :: held 0.794s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created reservations ['33617c7d-ea74-4756-bdb6-fa75f2466db1', '64e56f67-1632-403c-a279-7f3f8e358969', '2a255d4e-1a4e-47ef-9b26-9b4505d8e92d', '3e5fb20e-c7ad-4eaa-be91-3aba5118bd26'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-e5425010-6a52-4594-9857-2139bfd4220c-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-e5425010-6a52-4594-9857-2139bfd4220c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:16 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-quobyte-e5425010-6a52-4594-9857-2139bfd4220c" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-e5425010-6a52-4594-9857-2139bfd4220c" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-6d844ff4-df7f-45cd-8b37-c3c168aac2dc-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b47552-ea55-443b-a367-7e1ab4354e2c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 1G" returned: 0 in 0.609s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9156c307-de47-458a-96fd-2a102fdd8bf3 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-6d844ff4-df7f-45cd-8b37-c3c168aac2dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-93d7f075-e983-4959-a61f-c885ace52845" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:16 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9156c307-de47-458a-96fd-2a102fdd8bf3 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 Jul 19 13:21:16 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-93d7f075-e983-4959-a61f-c885ace52845" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-6d844ff4-df7f-45cd-8b37-c3c168aac2dc" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-6d844ff4-df7f-45cd-8b37-c3c168aac2dc" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Deleting offline snapshot 6d844ff4-df7f-45cd-8b37-c3c168aac2dc of volume 93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:16 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c Jul 19 13:21:16 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:16 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] snapshot_file for this snap is: volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:16 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Deleted volume successfully. Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c7934b-d5c5-4085-a758-e5a4084fa438]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-43dbeb8e-d1df-4c81-b0c7-96c4fd85ae46 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-9b7b01d8-1c0c-4298-b80d-501f1d7070c7-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:16 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc Jul 19 13:21:16 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:16 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9156c307-de47-458a-96fd-2a102fdd8bf3 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624" returned: 0 in 0.419s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:16 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 is being set with open permissions: ugo+rw Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c" returned: 0 in 0.493s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 Jul 19 13:21:16 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:16 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c Jul 19 13:21:16 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:16 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc" returned: 0 in 0.472s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93d7f075-e983-4959-a61f-c885ace52845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a6e23b-3ad4-4e31-8edd-c40898be7bbb]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624" returned: 0 in 0.278s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:16 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e5425010-6a52-4594-9857-2139bfd4220c" returned: 0 in 0.312s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:16 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.info Jul 19 13:21:16 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-e5425010-6a52-4594-9857-2139bfd4220c" released by "delete_volume" :: held 0.886s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:17 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 Jul 19 13:21:17 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Created reservations ['14ca33a7-6ad4-4da4-bd22-e14b4ca4f0d5', 'e224b1ce-d854-4283-bcb3-f1aa465d6aa0', '90e2b9b7-89cf-417f-b184-3d5aadcb6da9', 'e4597589-fde3-4e8a-8843-79ae780325c6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:17 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:17 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:17 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.info" returned: 0 in 0.324s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:17 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.info is being set with open permissions: ugo+rw Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:17 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.info Jul 19 13:21:17 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:17 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845" returned: 0 in 0.481s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:17 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc Jul 19 13:21:17 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:17 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.302s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Deleted volume successfully. Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-86ee1fab-b070-4299-8722-5f612f16d986 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-e5425010-6a52-4594-9857-2139bfd4220c-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:17 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.info" returned: 0 in 0.282s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-abff7cd1-23bc-4a18-821b-804f15110fe2 tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:21:17 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc" returned: 0 in 0.369s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:17 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc Jul 19 13:21:17 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:17 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845.6d844ff4-df7f-45cd-8b37-c3c168aac2dc" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-6d844ff4-df7f-45cd-8b37-c3c168aac2dc" released by "_delete_snapshot" :: held 1.727s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-93d7f075-e983-4959-a61f-c885ace52845" released by "delete_snapshot" :: held 1.765s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created reservations ['2f374d2b-087e-47c9-81b8-c2720a1fecbd', '9b98abce-ce1f-4488-93b8-bdf851765ed0', '86dd8edd-f03d-4f2a-a64c-24e648f29c8d', 'a33cc2a8-1b42-4823-9eef-46b92f5df1e9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-2f1061da-40c9-45d7-960f-2247c2533624-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Delete snapshot completed successfully. Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5b771cb7-45e8-4191-90a2-a42f3f249de2 tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-6d844ff4-df7f-45cd-8b37-c3c168aac2dc-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Lock "cinder-2f1061da-40c9-45d7-960f-2247c2533624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-9156c307-de47-458a-96fd-2a102fdd8bf3" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-9156c307-de47-458a-96fd-2a102fdd8bf3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-2f1061da-40c9-45d7-960f-2247c2533624" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-2f1061da-40c9-45d7-960f-2247c2533624" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot 2f1061da-40c9-45d7-960f-2247c2533624 of volume 9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-72cfceea-cf70-479f-b993-63fa730639cd-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a051f-21d2-4c9c-a297-04fab991e290]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-72cfceea-cf70-479f-b993-63fa730639cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-93d7f075-e983-4959-a61f-c885ace52845-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-93d7f075-e983-4959-a61f-c885ace52845-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-quobyte-72cfceea-cf70-479f-b993-63fa730639cd" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:18 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-72cfceea-cf70-479f-b993-63fa730639cd" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:18 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "cinder-quobyte-93d7f075-e983-4959-a61f-c885ace52845" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fefa78a-dd1b-4e0f-b54b-c8eee5b22ee7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-93d7f075-e983-4959-a61f-c885ace52845" acquired by "delete_volume" :: waited 0.036s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66865af-3031-4bb8-9d0e-888f24f0ddff]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:18 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd Jul 19 13:21:18 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:18 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 Jul 19 13:21:18 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:18 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624" returned: 0 in 0.446s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9156c307-de47-458a-96fd-2a102fdd8bf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1fea79-2e66-44e3-83c3-cd72ef92c9ef]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:18 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd" returned: 0 in 0.406s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:18 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 Jul 19 13:21:18 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:18 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd Jul 19 13:21:18 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:19 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845" returned: 0 in 0.469s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:19 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845 Jul 19 13:21:19 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:19 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72cfceea-cf70-479f-b993-63fa730639cd" returned: 0 in 0.300s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:19 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3" returned: 0 in 0.412s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-72cfceea-cf70-479f-b993-63fa730639cd" released by "delete_volume" :: held 0.783s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:19 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 Jul 19 13:21:19 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Created reservations ['3a517cbf-e8b5-40a7-b03b-838ced9d0bb3', 'e0b7cb47-7c83-4d01-be97-d14c7e84af06', '2d0456ae-1365-4e62-bba5-9c3da672f52a', '32826e08-dd73-4fd3-9067-4685ab0a50ea'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:19 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-93d7f075-e983-4959-a61f-c885ace52845" returned: 0 in 0.294s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-quobyte-93d7f075-e983-4959-a61f-c885ace52845" released by "delete_volume" :: held 0.849s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:19 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:19 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Created reservations ['f0601efd-98e8-4943-b978-53c6a2cfe079', '9349448f-bec5-4f2f-bf2c-92d6e50f956d', '4364fe9a-f5b9-4b2d-bc48-fc665455d90b', 'c277622d-45c5-4c1e-8b8d-c9067c87a30e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-d976ca92-14ae-4da9-ba1c-68e4c73c93c1-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-d976ca92-14ae-4da9-ba1c-68e4c73c93c1-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-quobyte-d976ca92-14ae-4da9-ba1c-68e4c73c93c1" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-d976ca92-14ae-4da9-ba1c-68e4c73c93c1" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:19 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:19 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:19 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624" returned: 0 in 0.522s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6176350a-d25e-454f-ba68-757820dd0f02]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:19 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624 Jul 19 13:21:19 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:19 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.435s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:19 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Deleted volume successfully. Jul 19 13:21:19 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6ccc8830-4a5c-4f8a-a1cd-242a5237dd98 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-72cfceea-cf70-479f-b993-63fa730639cd-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:19 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 Jul 19 13:21:19 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:19 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.313s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Deleted volume successfully. Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f330f8eb-72f7-43d8-b11b-1d29a2bcc6cd tempest-CreateVolumesFromSnapshotTest-1460635415 None] Lock "cinder-93d7f075-e983-4959-a61f-c885ace52845-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:20 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3.2f1061da-40c9-45d7-960f-2247c2533624" returned: 0 in 0.333s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-2f1061da-40c9-45d7-960f-2247c2533624" released by "_delete_snapshot" :: held 1.862s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-9156c307-de47-458a-96fd-2a102fdd8bf3" released by "delete_snapshot" :: held 1.904s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Created reservations ['9989b0cc-b934-4874-8cc7-aaf0db48ead9', '045f9d30-1ba7-4efb-b0b7-531e65293dfa', 'b58d84d6-bc07-42a1-895b-78fe0097266c', 'ebf8a9a3-e10c-4bb5-be71-cb9a9c0872d7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:20 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:20 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1 Jul 19 13:21:20 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e9e00624-ca6a-4cf9-b6cb-2da230742daf tempest-ProjectMemberTests-2078871870 None] Lock "cinder-2f1061da-40c9-45d7-960f-2247c2533624-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-9156c307-de47-458a-96fd-2a102fdd8bf3-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-9156c307-de47-458a-96fd-2a102fdd8bf3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-9156c307-de47-458a-96fd-2a102fdd8bf3" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-9156c307-de47-458a-96fd-2a102fdd8bf3" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[599cf6d8-81dc-4abd-86d9-7a04ffda18ab]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:20 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d976ca92-14ae-4da9-ba1c-68e4c73c93c1" returned: 0 in 0.282s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-d976ca92-14ae-4da9-ba1c-68e4c73c93c1" released by "delete_volume" :: held 0.812s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Created reservations ['4840f9fa-5fc6-413e-9b4e-b3f45f383973', '4a923873-4176-442f-b51e-695a20e967cb', '42ebbb4b-20c5-433b-9d80-70320b2501e6', 'be548881-7d8e-4dc9-b352-685f6e92c090'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:20 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 Jul 19 13:21:20 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:20 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:20 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-0e12316c-ac1d-4ee6-b77e-023abeb23b20-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-0e12316c-ac1d-4ee6-b77e-023abeb23b20-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-quobyte-0e12316c-ac1d-4ee6-b77e-023abeb23b20" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-0e12316c-ac1d-4ee6-b77e-023abeb23b20" acquired by "delete_volume" :: waited 0.028s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a68f49e-d513-4293-b1a3-1cebf838b3aa]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:21 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3" returned: 0 in 0.572s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:21 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3 Jul 19 13:21:21 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:21 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.468s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:21 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Deleted volume successfully. Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f6328a34-bcec-4285-b453-49819c67572a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-d976ca92-14ae-4da9-ba1c-68e4c73c93c1-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:21 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 Jul 19 13:21:21 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:21 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9156c307-de47-458a-96fd-2a102fdd8bf3" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-9156c307-de47-458a-96fd-2a102fdd8bf3" released by "delete_volume" :: held 1.042s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Created reservations ['f9a4d80b-b30b-4e93-879e-e0e0076b4bdb', 'feb32f9f-6bca-48a0-ab8f-be9b0936be49', '68351b05-3422-4499-8a88-6ec9f72b1661', 'c2dcfd3d-894c-48ad-adf4-cd96b0b9682b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:21 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20" returned: 0 in 0.736s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:21 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:21 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:21 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20 Jul 19 13:21:21 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:22 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:21:22 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0e12316c-ac1d-4ee6-b77e-023abeb23b20" returned: 0 in 0.377s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-0e12316c-ac1d-4ee6-b77e-023abeb23b20" released by "delete_volume" :: held 1.183s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-487247b6-d9f8-4aaa-8f09-a692b54b3545 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-9156c307-de47-458a-96fd-2a102fdd8bf3-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Created reservations ['1248188c-1e10-444d-b2a6-99049466a626', '7d3cac24-86b3-4699-8b9b-9aa797587c22', '82cebad5-2c5a-4d65-9867-bd95024281f7', '8df36187-de00-4f8a-9bef-d0a941bd9197'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:22 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:22 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:22 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.296s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Deleted volume successfully. Jul 19 13:21:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2e47aef0-165d-40fb-9294-ba2e950b8c5a tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-0e12316c-ac1d-4ee6-b77e-023abeb23b20-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-0a50ead5-847f-4835-9afd-ea5deed3e500-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-0a50ead5-847f-4835-9afd-ea5deed3e500-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (a5374559-e6ba-4aa7-bbda-cc934410b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3402f9-f22f-41dc-8f2d-b78a440d80b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3402f9-f22f-41dc-8f2d-b78a440d80b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705027191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4a640c-6cdf-4a29-bc61-93d0678205f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:23Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4432d985-ba50-4c16-ad2a-415799f8109f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4432d985-ba50-4c16-ad2a-415799f8109f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabec8e3-bbc6-45fb-bf8f-376b29ce0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabec8e3-bbc6-45fb-bf8f-376b29ce0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4a640c-6cdf-4a29-bc61-93d0678205f5', 'volume_name': 'volume-da4a640c-6cdf-4a29-bc61-93d0678205f5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5988101b-b88c-4815-9a35-4cf1440efdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5988101b-b88c-4815-9a35-4cf1440efdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857928c3-9501-4a95-b9ee-84fe5006fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:23 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Volume da4a640c-6cdf-4a29-bc61-93d0678205f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4a640c-6cdf-4a29-bc61-93d0678205f5', 'volume_size': 1} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705027191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4a640c-6cdf-4a29-bc61-93d0678205f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:23Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Creating volume da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:23 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "cinder-quobyte-0a50ead5-847f-4835-9afd-ea5deed3e500" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:23 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 1073741824 Jul 19 13:21:23 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-0a50ead5-847f-4835-9afd-ea5deed3e500" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b06ece-e015-4457-b472-efcd6db2186b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:23 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 Jul 19 13:21:23 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:23 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500" returned: 0 in 0.467s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:23 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 1073741824" returned: 0 in 0.579s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:23 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500 Jul 19 13:21:23 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:24 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 Jul 19 13:21:24 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:24 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0a50ead5-847f-4835-9afd-ea5deed3e500" returned: 0 in 0.410s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-quobyte-0a50ead5-847f-4835-9afd-ea5deed3e500" released by "delete_volume" :: held 0.940s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:24 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5" returned: 0 in 0.356s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857928c3-9501-4a95-b9ee-84fe5006fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4a640c-6cdf-4a29-bc61-93d0678205f5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ad46ad-9c6b-4196-a580-bf434532b477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:24 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Volume volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 (da4a640c-6cdf-4a29-bc61-93d0678205f5): created successfully Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ad46ad-9c6b-4196-a580-bf434532b477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (a5374559-e6ba-4aa7-bbda-cc934410b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Created reservations ['ab0ff6c3-c471-44b2-bcfa-9db2c96784dd', '1ba9a1b9-1165-4582-80b2-206f466266e5', 'aa8d0dae-2415-4f20-b829-7dc268cf86e5', 'd8f7530f-3501-4ed1-9c43-3ec33cdfa621'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0f3979df-fe90-404a-8d2b-aa26d969f230 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:24 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:24 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:24 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.359s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Deleted volume successfully. Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-72de28e0-6db2-47fb-b0ae-7e1ac5dfa314 tempest-CreateVolumesFromImageTest-1930889840 None] Lock "cinder-0a50ead5-847f-4835-9afd-ea5deed3e500-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Flow 'volume_create_manager' (1c2a80ae-5ff7-4b79-a7ef-c071e07b825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e286a73f-1f83-4b82-b269-879852ee54d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e286a73f-1f83-4b82-b269-879852ee54d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1054313210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66ccafc-43d5-4436-9c64-b6f3796eb2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c975b5d5a24d839c55a702445e38bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:25Z,use_quota=True,user_id='066cf87f0aef4ca2ba3f8925beaeadb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883bbbc5-ceeb-4608-a358-6fd190504beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883bbbc5-ceeb-4608-a358-6fd190504beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27e5ea7-e7c8-4ee2-8955-38c6bcb9df7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27e5ea7-e7c8-4ee2-8955-38c6bcb9df7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66ccafc-43d5-4436-9c64-b6f3796eb2eb', 'volume_name': 'volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ad9245-1f6e-4e5e-9dce-f1ac1b1d4789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ad9245-1f6e-4e5e-9dce-f1ac1b1d4789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b268411-f7b1-4571-9d88-e5c49df1c4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Volume e66ccafc-43d5-4436-9c64-b6f3796eb2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb', 'volume_size': 1} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1054313210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66ccafc-43d5-4436-9c64-b6f3796eb2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c975b5d5a24d839c55a702445e38bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:25Z,use_quota=True,user_id='066cf87f0aef4ca2ba3f8925beaeadb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Creating volume e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:25 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:25 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb 1073741824 Jul 19 13:21:25 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (d4da8c01-73e9-42a2-a414-036b2917f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121bee0-4169-492e-a077-061f4cba1c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121bee0-4169-492e-a077-061f4cba1c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528199100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a16ce0-302b-449a-a9c2-656badbdce31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:25Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef280464-4eb6-4a3f-ad21-97039cc9a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef280464-4eb6-4a3f-ad21-97039cc9a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4357a2-c32e-4e40-8517-e9cf6a268fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4357a2-c32e-4e40-8517-e9cf6a268fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a16ce0-302b-449a-a9c2-656badbdce31', 'volume_name': 'volume-d4a16ce0-302b-449a-a9c2-656badbdce31', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbb21e7-ebdf-408f-b2cf-e9089f1a68f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbb21e7-ebdf-408f-b2cf-e9089f1a68f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acad4ff9-7910-4a41-8246-e3ad10811609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Volume d4a16ce0-302b-449a-a9c2-656badbdce31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a16ce0-302b-449a-a9c2-656badbdce31', 'volume_size': 1} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:25 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb 1073741824" returned: 0 in 0.552s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:25 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb Jul 19 13:21:25 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:25 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528199100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a16ce0-302b-449a-a9c2-656badbdce31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:25Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Creating volume d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:25 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:25 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 1073741824 Jul 19 13:21:25 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b268411-f7b1-4571-9d88-e5c49df1c4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b91434-446c-4b17-b060-1a80b8c5f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:25 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Volume volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb (e66ccafc-43d5-4436-9c64-b6f3796eb2eb): created successfully Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b91434-446c-4b17-b060-1a80b8c5f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:25 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Flow 'volume_create_manager' (1c2a80ae-5ff7-4b79-a7ef-c071e07b825e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a6758b46-ceee-4e08-98f2-79bcbec9306b tempest-VolumeDependencyTests-737730285 None] Created volume successfully. Jul 19 13:21:26 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 1073741824" returned: 0 in 0.463s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:26 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 Jul 19 13:21:26 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:26 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31" returned: 0 in 0.269s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.107s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acad4ff9-7910-4a41-8246-e3ad10811609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a16ce0-302b-449a-a9c2-656badbdce31', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbdf2c9-1fba-40a8-9b14-bcde43cc51f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot 5bea9bc7-fc76-4df6-947a-edecbdc81072 of volume da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:26 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Volume volume-d4a16ce0-302b-449a-a9c2-656badbdce31 (d4a16ce0-302b-449a-a9c2-656badbdce31): created successfully Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbdf2c9-1fba-40a8-9b14-bcde43cc51f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (d4da8c01-73e9-42a2-a414-036b2917f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf8daf-12df-4a88-9573-93653b67fc68]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f31c378d-0e81-4929-97c9-8df158d49e7d tempest-ProjectReaderTests-907117873 None] Created volume successfully. Jul 19 13:21:26 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 Jul 19 13:21:26 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:27 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5" returned: 0 in 0.495s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:27 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 1G Jul 19 13:21:27 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:27 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 1G" returned: 0 in 0.492s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:27 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 Jul 19 13:21:27 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (a736a0de-09d8-4e28-a7bf-8571eca14d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1799de-44d3-497e-9f04-1bbb48dd9982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1799de-44d3-497e-9f04-1bbb48dd9982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175615856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:28Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01dbd57-531c-46ba-a55b-db21e5b1699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01dbd57-531c-46ba-a55b-db21e5b1699d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9177f1e4-f75c-4722-a783-ccf424bb20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9177f1e4-f75c-4722-a783-ccf424bb20dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5', 'volume_name': 'volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc470ae3-6bf2-4c4b-bc76-da1cd7666777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc470ae3-6bf2-4c4b-bc76-da1cd7666777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d69124-55ed-47f3-8f82-4de33ada40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:27 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume 68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5', 'volume_size': 1} Jul 19 13:21:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:27 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072" returned: 0 in 0.303s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:28 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 is being set with open permissions: ugo+rw Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:28 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 Jul 19 13:21:28 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:28 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072" returned: 0 in 0.242s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:28 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.info Jul 19 13:21:28 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:28 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.info" returned: 0 in 0.247s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:28 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.info is being set with open permissions: ugo+rw Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:28 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.info Jul 19 13:21:28 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:28 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.info" returned: 0 in 0.235s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.629s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Creating offline snapshot 35a37784-4cb0-44a8-9a96-959939dc7109 of volume e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:28 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ffb306cb-3ff4-4972-aed5-e0a8c9181c52 tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f311db8a-6d5d-44ba-b30a-119ae6e2badd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:28 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb Jul 19 13:21:28 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:29 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" returned: 0 in 0.370s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:29 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 1G Jul 19 13:21:29 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:29 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 1G" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:29 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 Jul 19 13:21:29 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-5bea9bc7-fc76-4df6-947a-edecbdc81072-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-5bea9bc7-fc76-4df6-947a-edecbdc81072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-da4a640c-6cdf-4a29-bc61-93d0678205f5" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-da4a640c-6cdf-4a29-bc61-93d0678205f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-5bea9bc7-fc76-4df6-947a-edecbdc81072" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-5bea9bc7-fc76-4df6-947a-edecbdc81072" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot 5bea9bc7-fc76-4df6-947a-edecbdc81072 of volume da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d23cb3-6df5-4cd5-a6ac-5053fecf1ea1]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:29 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109" returned: 0 in 0.312s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:29 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 is being set with open permissions: ugo+rw Jul 19 13:21:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:29 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 Jul 19 13:21:29 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:29 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 Jul 19 13:21:29 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:30 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109" returned: 0 in 0.242s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:30 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072" returned: 0 in 0.375s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4a640c-6cdf-4a29-bc61-93d0678205f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:30 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.info Jul 19 13:21:30 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb83df3-671a-4d95-83c6-77a1e9132b42]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:30 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 Jul 19 13:21:30 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:30 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.info" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:30 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.info is being set with open permissions: ugo+rw Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:30 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.info Jul 19 13:21:30 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:30 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5" returned: 0 in 0.359s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:30 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 Jul 19 13:21:30 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:30 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.info" returned: 0 in 0.247s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.271s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Creating offline snapshot 46e00591-e9e9-47c4-a674-d36332bff500 of volume d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fe612bf5-c549-420c-b3a8-de4e4f49bf27 tempest-VolumeDependencyTests-737730285 None] Create snapshot completed successfully Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe0031d-9493-48c0-a6e5-97ee1e142dea]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:30 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 Jul 19 13:21:30 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:30 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072" returned: 0 in 0.346s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:30 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072 Jul 19 13:21:30 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:31 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31" returned: 0 in 0.367s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:31 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 1G Jul 19 13:21:31 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:31 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5.5bea9bc7-fc76-4df6-947a-edecbdc81072" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-5bea9bc7-fc76-4df6-947a-edecbdc81072" released by "_delete_snapshot" :: held 1.444s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-da4a640c-6cdf-4a29-bc61-93d0678205f5" released by "delete_snapshot" :: held 1.464s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Created reservations ['2acd8456-863f-46d7-84c4-02f0e9324938', 'bf0675a3-38b8-4a99-8ae8-cb0717838eff', 'bbbd0781-0309-4388-95f5-e1a7346aa99f', '30966292-ab38-4f6f-b761-21514ea0d475'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:31 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-0cfa887e-2ae8-4347-bd7d-05d817bc17a4 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-5bea9bc7-fc76-4df6-947a-edecbdc81072-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:31 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 1G" returned: 0 in 0.449s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a16ce0-302b-449a-a9c2-656badbdce31 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:31 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a16ce0-302b-449a-a9c2-656badbdce31 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 Jul 19 13:21:31 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:31 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a16ce0-302b-449a-a9c2-656badbdce31 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500" returned: 0 in 0.342s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:31 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 is being set with open permissions: ugo+rw Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:31 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 Jul 19 13:21:31 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Flow 'volume_create_manager' (8c1caf29-5c42-46bc-a8e0-9c692152335d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d9571f-94d8-4a12-878c-7a6ccb110f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-da4a640c-6cdf-4a29-bc61-93d0678205f5-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d9571f-94d8-4a12-878c-7a6ccb110f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-77287263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58d03bb-797b-4c3a-8288-094b19cac172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c975b5d5a24d839c55a702445e38bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35a37784-4cb0-44a8-9a96-959939dc7109,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:32Z,use_quota=True,user_id='066cf87f0aef4ca2ba3f8925beaeadb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e92ff6-975e-4825-96c5-501541843485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e92ff6-975e-4825-96c5-501541843485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6b4c16-f945-4602-8059-55421bba6c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6b4c16-f945-4602-8059-55421bba6c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c58d03bb-797b-4c3a-8288-094b19cac172', 'volume_name': 'volume-c58d03bb-797b-4c3a-8288-094b19cac172', 'volume_size': 1, 'snapshot_id': '35a37784-4cb0-44a8-9a96-959939dc7109'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:31 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ba7df-9d19-464a-b63a-64b733e22457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ba7df-9d19-464a-b63a-64b733e22457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8c4877-b49d-4ca3-a4e8-19c938fcc1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:32 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Volume c58d03bb-797b-4c3a-8288-094b19cac172: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c58d03bb-797b-4c3a-8288-094b19cac172', 'volume_size': 1, 'snapshot_id': '35a37784-4cb0-44a8-9a96-959939dc7109'} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Lock "cinder-da4a640c-6cdf-4a29-bc61-93d0678205f5-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-da4a640c-6cdf-4a29-bc61-93d0678205f5" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-da4a640c-6cdf-4a29-bc61-93d0678205f5" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4664a9f4-50e9-4805-b857-9be2df92cce4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:32 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:32 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.info Jul 19 13:21:32 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:32 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 Jul 19 13:21:32 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:32 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.info" returned: 0 in 0.268s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:32 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.info is being set with open permissions: ugo+rw Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:32 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.info Jul 19 13:21:32 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:32 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5" returned: 0 in 0.386s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:32 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5 Jul 19 13:21:32 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:32 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.info" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.747s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175615856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:28Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Creating volume 68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:32 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:32 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-da4a640c-6cdf-4a29-bc61-93d0678205f5" returned: 0 in 0.264s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:32 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 1073741824 Jul 19 13:21:32 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-da4a640c-6cdf-4a29-bc61-93d0678205f5" released by "delete_volume" :: held 0.731s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:32 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-60357c4d-86ed-4e6c-897c-a7d4bd8a8a2c tempest-ProjectReaderTests-907117873 None] Create snapshot completed successfully Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Created reservations ['4fae63e1-7919-46f9-941f-3c796b6147a3', '92a90f74-5fb7-4acb-a94d-a52840a7cb6c', '5cd62d17-2c03-482a-a532-a018b99080f7', '388c0775-f99b-43d5-8225-126dc9ec6698'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:32 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:32 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:33 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6eda89af-b36f-485f-95bf-38d3d844af9d tempest-ProjectMemberTests-2078871870 None] Lock "cinder-da4a640c-6cdf-4a29-bc61-93d0678205f5-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:33 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 1073741824" returned: 0 in 0.516s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:33 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 Jul 19 13:21:33 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:33 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (41dc6b57-164a-4eb3-8203-c7083da88996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65e4cab-d2b2-412d-b809-362e5ea7779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5" returned: 0 in 0.299s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.564s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-quobyte-35a37784-4cb0-44a8-9a96-959939dc7109-c58d03bb-797b-4c3a-8288-094b19cac172" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65e4cab-d2b2-412d-b809-362e5ea7779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210166434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170ecdec-aa6b-4a50-9a61-d87203c17e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:33Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887b99bf-3978-4627-a05c-6b36606ba120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887b99bf-3978-4627-a05c-6b36606ba120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5307a-e794-4b56-be48-8c4db4581093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5307a-e794-4b56-be48-8c4db4581093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170ecdec-aa6b-4a50-9a61-d87203c17e30', 'volume_name': 'volume-170ecdec-aa6b-4a50-9a61-d87203c17e30', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b23dbec-79b7-4f5d-8b5e-ebd8c354b5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b23dbec-79b7-4f5d-8b5e-ebd8c354b5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eece6a2-d95d-4459-93af-c033619e62cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:33 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Volume 170ecdec-aa6b-4a50-9a61-d87203c17e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170ecdec-aa6b-4a50-9a61-d87203c17e30', 'volume_size': 1} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d69124-55ed-47f3-8f82-4de33ada40f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05d7e90-b346-46f4-bc4b-18653c6b972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-35a37784-4cb0-44a8-9a96-959939dc7109-c58d03bb-797b-4c3a-8288-094b19cac172" acquired by "_create_volume_from_snapshot" :: waited 0.077s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Creating volume c58d03bb-797b-4c3a-8288-094b19cac172 from snapshot 35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-quobyte-c58d03bb-797b-4c3a-8288-094b19cac172" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:33 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 (68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5): created successfully Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05d7e90-b346-46f4-bc4b-18653c6b972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (a736a0de-09d8-4e28-a7bf-8571eca14d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-c58d03bb-797b-4c3a-8288-094b19cac172" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] snapshot: 35a37784-4cb0-44a8-9a96-959939dc7109, volume: c58d03bb-797b-4c3a-8288-094b19cac172, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-568bd769-5104-4a06-bd2c-3c0f970b88a9 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created volume successfully. Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0dbc36-f8e6-46ad-b445-4b1bfe82d0cd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:33 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 Jul 19 13:21:33 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-46e00591-e9e9-47c4-a674-d36332bff500-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Lock "cinder-46e00591-e9e9-47c4-a674-d36332bff500-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-d4a16ce0-302b-449a-a9c2-656badbdce31" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-d4a16ce0-302b-449a-a9c2-656badbdce31" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-46e00591-e9e9-47c4-a674-d36332bff500" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-46e00591-e9e9-47c4-a674-d36332bff500" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Deleting offline snapshot 46e00591-e9e9-47c4-a674-d36332bff500 of volume d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:34 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] snapshot_file for this snap is: volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109" returned: 0 in 0.409s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c4ef63-339b-4c7f-8d05-7a8183dc0a70]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[70635844-00d1-462c-a7f1-2f4ea942953b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:34 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb Jul 19 13:21:34 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:34 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 Jul 19 13:21:34 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:34 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a16ce0-302b-449a-a9c2-656badbdce31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:34 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" returned: 0 in 0.417s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[741808a2-f91f-4cd7-9057-dec4c92b2f76]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:34 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 Jul 19 13:21:34 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:34 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 Jul 19 13:21:34 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (cbdb7bff-7767-497e-a8ba-45fd0cb5adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7318d337-8888-4e72-9161-15324d5477e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7318d337-8888-4e72-9161-15324d5477e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013182539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8174cea5-b439-4f1d-9ea4-78090aafa36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:35Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95f7be0-65fb-4435-84b8-d3c67f4708a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95f7be0-65fb-4435-84b8-d3c67f4708a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc29bd8-d20f-4cc4-bb79-8dca85cafead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc29bd8-d20f-4cc4-bb79-8dca85cafead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8174cea5-b439-4f1d-9ea4-78090aafa36d', 'volume_name': 'volume-8174cea5-b439-4f1d-9ea4-78090aafa36d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81066495-3d7f-45e3-9730-2d972a08e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81066495-3d7f-45e3-9730-2d972a08e71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e3918c-03f7-446f-910a-ef2cd729b765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:34 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume 8174cea5-b439-4f1d-9ea4-78090aafa36d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8174cea5-b439-4f1d-9ea4-78090aafa36d', 'volume_size': 1} Jul 19 13:21:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:35 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:35 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 Jul 19 13:21:35 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (453233a6-ad8e-4a58-b191-2dbf5288f19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca67363a-3a56-4c36-aa48-f19545c25191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca67363a-3a56-4c36-aa48-f19545c25191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219150523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e04f7e-d065-4997-a9fd-b9604fdbf8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:35Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3ebec8-73e7-4a52-a06a-a753f2c4e605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3ebec8-73e7-4a52-a06a-a753f2c4e605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b732151c-2df5-4951-b8a0-8c94a9accbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b732151c-2df5-4951-b8a0-8c94a9accbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e04f7e-d065-4997-a9fd-b9604fdbf8d0', 'volume_name': 'volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a908b833-d9c3-4c4a-aa19-34155583575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a908b833-d9c3-4c4a-aa19-34155583575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7121a48-9ff1-45c0-a2d4-271dc6c9b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:35 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume 35e04f7e-d065-4997-a9fd-b9604fdbf8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0', 'volume_size': 1} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:35 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500" returned: 0 in 0.653s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:35 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500 Jul 19 13:21:35 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:35 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (33aff1ab-70ce-430f-b53e-ba0411b355da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe27f703-50b0-412c-8498-3d4a3794ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe27f703-50b0-412c-8498-3d4a3794ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-605644195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7550d313-c703-4a06-b36b-53f73133b22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:36Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2b9965-d1a3-445a-8779-d48805b7d808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2b9965-d1a3-445a-8779-d48805b7d808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7237394a-cdb2-48d7-aece-f9a1a5713541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7237394a-cdb2-48d7-aece-f9a1a5713541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7550d313-c703-4a06-b36b-53f73133b22d', 'volume_name': 'volume-7550d313-c703-4a06-b36b-53f73133b22d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eda0d04-809a-403d-9154-92e1399228ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eda0d04-809a-403d-9154-92e1399228ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd15cd6-bf0a-409f-aa9b-f4fac3ba8ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:36 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume 7550d313-c703-4a06-b36b-53f73133b22d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7550d313-c703-4a06-b36b-53f73133b22d', 'volume_size': 1} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:36 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31.46e00591-e9e9-47c4-a674-d36332bff500" returned: 0 in 0.824s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-46e00591-e9e9-47c4-a674-d36332bff500" released by "_delete_snapshot" :: held 2.535s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-d4a16ce0-302b-449a-a9c2-656badbdce31" released by "delete_snapshot" :: held 2.574s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (eb73c616-01fa-410d-bb9c-b913d6203525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b73edb6-aa3e-46f0-9faa-2d3e96cab878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Created reservations ['e3cc202d-8ee1-4b53-b045-a908a27ac3fd', 'f4f88c1b-2849-47a3-991d-9576f857dc06', 'aeaf46e6-3817-43a9-ac8a-698b445e999d', '4ea7006d-9a1a-40d9-9ca1-2595c97e9442'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b73edb6-aa3e-46f0-9faa-2d3e96cab878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255376877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65adf311-9777-48fc-941d-b0a65dc2cf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:37Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c232d7-f13f-4b51-a1f2-8280ef1d77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c232d7-f13f-4b51-a1f2-8280ef1d77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7f367d-58cc-42fd-8291-42950af05d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7f367d-58cc-42fd-8291-42950af05d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65adf311-9777-48fc-941d-b0a65dc2cf2e', 'volume_name': 'volume-65adf311-9777-48fc-941d-b0a65dc2cf2e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fdce47-6716-41a2-a36f-72d9abeb2040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fdce47-6716-41a2-a36f-72d9abeb2040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f63797-7b7a-4559-aec6-66cf9eca7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:37 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume 65adf311-9777-48fc-941d-b0a65dc2cf2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65adf311-9777-48fc-941d-b0a65dc2cf2e', 'volume_size': 1} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:37 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Delete snapshot completed successfully. Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-50edfc3f-55f0-40ef-9d22-970f7d8316ad tempest-ProjectReaderTests-907117873 None] Lock "cinder-46e00591-e9e9-47c4-a674-d36332bff500-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-d4a16ce0-302b-449a-a9c2-656badbdce31-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Lock "cinder-d4a16ce0-302b-449a-a9c2-656badbdce31-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-d4a16ce0-302b-449a-a9c2-656badbdce31" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-d4a16ce0-302b-449a-a9c2-656badbdce31" acquired by "delete_volume" :: waited 0.047s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (ad6f71ff-69c7-4ed6-9aa8-72535ff41152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33567e4d-dbd9-4b9e-8779-c28b76311b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7dc0a-2c79-4100-99fa-9b3e2726dbcd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33567e4d-dbd9-4b9e-8779-c28b76311b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-802237790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:38Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b781087d-dd8f-468d-8344-01a1de13de36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b781087d-dd8f-468d-8344-01a1de13de36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4834d2b1-83a9-483c-8d7b-c743c471eda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4834d2b1-83a9-483c-8d7b-c743c471eda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7', 'volume_name': 'volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a84d0f-bf65-4445-8507-4414d77058bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a84d0f-bf65-4445-8507-4414d77058bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100476bc-cb2e-469d-8a45-389d5c094baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:38 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume 46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7', 'volume_size': 1} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:38 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 Jul 19 13:21:38 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:38 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31" returned: 0 in 0.657s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:38 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31 Jul 19 13:21:38 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:39 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d4a16ce0-302b-449a-a9c2-656badbdce31" returned: 0 in 0.546s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-d4a16ce0-302b-449a-a9c2-656badbdce31" released by "delete_volume" :: held 1.428s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Created reservations ['d4495e8f-2dc8-4927-930d-bedba265e7dc', 'f6371148-4f09-497d-9390-e015cfa38986', 'ef504cc5-aeaf-42cd-9057-33c58e20cf20', '4249429c-bbd4-4549-8f55-5a493bf30e66'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:39 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:39 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:40 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172" returned: 0 in 5.500s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27d299-7323-424e-b107-7258f6d25df6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:40 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.472s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:40 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Deleted volume successfully. Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-58a2e866-9743-441f-9d1f-a0e1cf57f502 tempest-ProjectReaderTests-907117873 None] Lock "cinder-d4a16ce0-302b-449a-a9c2-656badbdce31-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:40 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb Jul 19 13:21:40 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (71350e90-a713-49cc-b4c8-894d7dc64be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d543c79-0945-4204-a978-1e87e36b2907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d543c79-0945-4204-a978-1e87e36b2907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369817121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0488a0c3-a05e-4327-be4b-f1a33eb7b564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:40Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d5cc92-478e-4b39-8aeb-955cc7e72212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d5cc92-478e-4b39-8aeb-955cc7e72212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42775cc-f7f8-4e70-a59d-f3a654af7616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42775cc-f7f8-4e70-a59d-f3a654af7616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0488a0c3-a05e-4327-be4b-f1a33eb7b564', 'volume_name': 'volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bee3a7b-e272-4f43-9b62-29db2d20522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bee3a7b-e272-4f43-9b62-29db2d20522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287cce44-0d0c-401d-9fd8-9171ec040c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:40 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Volume 0488a0c3-a05e-4327-be4b-f1a33eb7b564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564', 'volume_size': 1} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:40 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" returned: 0 in 0.586s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:21:40 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Converted 1024.00 MB image at 186.14 MB/s Jul 19 13:21:40 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 is being set with open permissions: ugo+rw Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:40 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 Jul 19 13:21:40 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:40 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172" returned: 0 in 0.232s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-c58d03bb-797b-4c3a-8288-094b19cac172" released by "_copy_volume_from_snapshot" :: held 7.252s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-35a37784-4cb0-44a8-9a96-959939dc7109-c58d03bb-797b-4c3a-8288-094b19cac172" released by "_create_volume_from_snapshot" :: held 7.294s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.373s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.318s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210166434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170ecdec-aa6b-4a50-9a61-d87203c17e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:33Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Creating volume 170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:40 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:41 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 1073741824 Jul 19 13:21:41 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8c4877-b49d-4ca3-a4e8-19c938fcc1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58d03bb-797b-4c3a-8288-094b19cac172', 'volume_size': 1, 'snapshot_id': '35a37784-4cb0-44a8-9a96-959939dc7109'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f8b32f-c39b-4d32-9bc2-b027fbc11f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Volume volume-c58d03bb-797b-4c3a-8288-094b19cac172 (c58d03bb-797b-4c3a-8288-094b19cac172): created successfully Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f8b32f-c39b-4d32-9bc2-b027fbc11f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Flow 'volume_create_manager' (8c1caf29-5c42-46bc-a8e0-9c692152335d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-545eb202-38e0-493e-aa83-dd6c4414b4a2 tempest-VolumeDependencyTests-737730285 None] Created volume successfully. Jul 19 13:21:41 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 1073741824" returned: 0 in 0.407s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:41 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 Jul 19 13:21:41 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:41 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30" returned: 0 in 0.241s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.809s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013182539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8174cea5-b439-4f1d-9ea4-78090aafa36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:35Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Creating volume 8174cea5-b439-4f1d-9ea4-78090aafa36d {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:41 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:41 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d 1073741824 Jul 19 13:21:41 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eece6a2-d95d-4459-93af-c033619e62cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170ecdec-aa6b-4a50-9a61-d87203c17e30', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0ab19e-0961-4f9d-9a2b-72219c016b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:41 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Volume volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 (170ecdec-aa6b-4a50-9a61-d87203c17e30): created successfully Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0ab19e-0961-4f9d-9a2b-72219c016b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (41dc6b57-164a-4eb3-8203-c7083da88996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b104b2ff-e023-43ed-a5c3-dd2f1e5ada2e tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-35a37784-4cb0-44a8-9a96-959939dc7109-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-35a37784-4cb0-44a8-9a96-959939dc7109-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-quobyte-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-quobyte-35a37784-4cb0-44a8-9a96-959939dc7109" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-35a37784-4cb0-44a8-9a96-959939dc7109" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Deleting offline snapshot 35a37784-4cb0-44a8-9a96-959939dc7109 of volume e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] snapshot_file for this snap is: volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[469b3369-2296-4523-9482-9953694674dd]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:41 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 Jul 19 13:21:41 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:42 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d 1073741824" returned: 0 in 0.444s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:42 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d Jul 19 13:21:42 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:42 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109" returned: 0 in 0.352s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc35243-9b20-493c-90fd-e427a51ba668]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:42 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb Jul 19 13:21:42 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:42 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.189s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219150523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e04f7e-d065-4997-a9fd-b9604fdbf8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:35Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Creating volume 35e04f7e-d065-4997-a9fd-b9604fdbf8d0 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:42 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:42 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 1073741824 Jul 19 13:21:42 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e3918c-03f7-446f-910a-ef2cd729b765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8174cea5-b439-4f1d-9ea4-78090aafa36d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:42 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:42 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbb2f72-0c51-4a7c-b23b-3dbdb6b235ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:42 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume volume-8174cea5-b439-4f1d-9ea4-78090aafa36d (8174cea5-b439-4f1d-9ea4-78090aafa36d): created successfully Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbb2f72-0c51-4a7c-b23b-3dbdb6b235ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (cbdb7bff-7767-497e-a8ba-45fd0cb5adeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:42 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-0cbb4e57-a999-4890-ae17-f9a6afaa6433 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created volume successfully. Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:42 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" returned: 0 in 0.423s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:42 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 Jul 19 13:21:42 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:42 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.298s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 28 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:21:42 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 1073741824" returned: 0 in 0.550s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:43 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109" returned: 0 in 0.361s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:43 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 Jul 19 13:21:43 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:43 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109 Jul 19 13:21:43 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:43 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.775s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-605644195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7550d313-c703-4a06-b36b-53f73133b22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:36Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Creating volume 7550d313-c703-4a06-b36b-53f73133b22d {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:43 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:43 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb.35a37784-4cb0-44a8-9a96-959939dc7109" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7121a48-9ff1-45c0-a2d4-271dc6c9b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:43 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d 1073741824 Jul 19 13:21:43 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36401d9c-cc52-41da-9b54-27031701e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:43 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 (35e04f7e-d065-4997-a9fd-b9604fdbf8d0): created successfully Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36401d9c-cc52-41da-9b54-27031701e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (453233a6-ad8e-4a58-b191-2dbf5288f19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-35a37784-4cb0-44a8-9a96-959939dc7109" released by "_delete_snapshot" :: held 1.518s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" released by "delete_snapshot" :: held 1.541s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-edf95aaf-891a-4286-8f87-234299dab1ac tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created volume successfully. Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Created reservations ['fecfda2a-2c7b-4968-bef3-36a6ed105895', '2fa4e75b-fd20-4acd-99fc-b1a08232de4e', '0c470468-8b0c-4893-940d-42a16c91d236', 'a18e25a8-45cc-45d7-9221-a1adc8457426'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Delete snapshot completed successfully. Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-5ba49424-072e-4eb8-835d-6e82fe81e5a2 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-35a37784-4cb0-44a8-9a96-959939dc7109-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:43 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d 1073741824" returned: 0 in 0.424s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:43 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d Jul 19 13:21:43 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-e66ccafc-43d5-4436-9c64-b6f3796eb2eb-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:43 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.877s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255376877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65adf311-9777-48fc-941d-b0a65dc2cf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:37Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Creating volume 65adf311-9777-48fc-941d-b0a65dc2cf2e {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:43 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd15cd6-bf0a-409f-aa9b-f4fac3ba8ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7550d313-c703-4a06-b36b-53f73133b22d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0b765b-397f-46b0-b28b-efa2a720b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-e66ccafc-43d5-4436-9c64-b6f3796eb2eb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:44 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e 1073741824 Jul 19 13:21:44 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:44 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume volume-7550d313-c703-4a06-b36b-53f73133b22d (7550d313-c703-4a06-b36b-53f73133b22d): created successfully Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0b765b-397f-46b0-b28b-efa2a720b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (33aff1ab-70ce-430f-b53e-ba0411b355da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:44 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-88b6438a-57fd-4f15-b602-850ebb2a798b tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created volume successfully. Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-quobyte-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" acquired by "delete_volume" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bebfc91-b671-4deb-bce9-90b48cadfc63]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:44 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb Jul 19 13:21:44 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:44 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e 1073741824" returned: 0 in 0.438s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:44 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e Jul 19 13:21:44 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:44 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" returned: 0 in 0.404s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:44 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb Jul 19 13:21:44 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:44 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e" returned: 0 in 0.261s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.653s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-802237790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f57aa9ca5843e2834192f2ccf674fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:38Z,use_quota=True,user_id='dd6474e514f545748bc4b7f2fac26aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Creating volume 46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:44 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:44 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 1073741824 Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f63797-7b7a-4559-aec6-66cf9eca7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65adf311-9777-48fc-941d-b0a65dc2cf2e', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:44 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5d533f-c83f-4fbb-b288-6c0ec020935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:44 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume volume-65adf311-9777-48fc-941d-b0a65dc2cf2e (65adf311-9777-48fc-941d-b0a65dc2cf2e): created successfully Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5d533f-c83f-4fbb-b288-6c0ec020935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (eb73c616-01fa-410d-bb9c-b913d6203525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:44 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:44 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1a76c19f-ee7b-4b26-bea3-8b3542e076bd tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created volume successfully. Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-e66ccafc-43d5-4436-9c64-b6f3796eb2eb" released by "delete_volume" :: held 0.750s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Created reservations ['0b34b0e0-788f-4b95-bba9-2109e0199639', '7de0b207-1fb3-4134-8aad-e40452da7b1b', 'd43e67d8-fbb5-471e-adcb-7c4617ef4ee3', '91d28d35-e299-4e02-9232-17a9b39d9069'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:44 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:44 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-c58d03bb-797b-4c3a-8288-094b19cac172-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Lock "cinder-c58d03bb-797b-4c3a-8288-094b19cac172-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:45 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.300s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Acquiring lock "cinder-quobyte-c58d03bb-797b-4c3a-8288-094b19cac172" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Deleted volume successfully. Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-c58d03bb-797b-4c3a-8288-094b19cac172" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-9257c086-224e-44b9-9df2-7aa230015282 tempest-VolumeDependencyTests-737730285 None] Lock "cinder-e66ccafc-43d5-4436-9c64-b6f3796eb2eb-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:45 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f58519-a490-4235-b9b4-1195a5200179]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 1073741824" returned: 0 in 0.593s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:45 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 Jul 19 13:21:45 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:45 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 Jul 19 13:21:45 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:45 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369817121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0488a0c3-a05e-4327-be4b-f1a33eb7b564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:40Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Creating volume 0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:45 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:45 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 1073741824 Jul 19 13:21:45 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100476bc-cb2e-469d-8a45-389d5c094baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71bd3ee-e2d2-42ca-aa13-be621cdbd39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:45 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Volume volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 (46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7): created successfully Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71bd3ee-e2d2-42ca-aa13-be621cdbd39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Flow 'volume_create_manager' (ad6f71ff-69c7-4ed6-9aa8-72535ff41152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:45 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172" returned: 0 in 0.373s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fc8bbe16-c9a2-4bcc-8c81-153391070741 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created volume successfully. Jul 19 13:21:45 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172 Jul 19 13:21:45 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:45 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-c58d03bb-797b-4c3a-8288-094b19cac172" returned: 0 in 0.266s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Lock "cinder-quobyte-c58d03bb-797b-4c3a-8288-094b19cac172" released by "delete_volume" :: held 0.691s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Created reservations ['999970b3-b581-4766-8814-262b2f857f52', '0e8de9d2-c754-4d86-96e9-cf7ffae2018f', '04a4a830-194a-42e5-8c12-1081a4ff89cb', '31b435db-a9fb-49d0-9b4f-6b8f4f2601f0'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:46 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 1073741824" returned: 0 in 0.400s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:46 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 Jul 19 13:21:46 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:46 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:46 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:46 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.729s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287cce44-0d0c-401d-9fd8-9171ec040c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59436913-3034-4cb8-ac41-092b79c5d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot 0a02776e-e744-4848-8b5e-c4b47724f5ba of volume 170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:46 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Deleted volume successfully. Jul 19 13:21:46 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Volume volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 (0488a0c3-a05e-4327-be4b-f1a33eb7b564): created successfully Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59436913-3034-4cb8-ac41-092b79c5d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (71350e90-a713-49cc-b4c8-894d7dc64be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984acd8-3337-4cc4-98b2-f5549a345e5a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-de1ee6d0-a158-4bdc-837f-947a8dd11541 tempest-ProjectReaderTests-907117873 None] Created volume successfully. Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76a50f9f-9b21-4cfc-813f-19158036c1fb tempest-VolumeDependencyTests-737730285 None] Lock "cinder-c58d03bb-797b-4c3a-8288-094b19cac172-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-quobyte-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:46 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 Jul 19 13:21:46 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d980aeb5-40b4-4a51-b309-54cf2842853d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:46 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 Jul 19 13:21:46 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:46 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30" returned: 0 in 0.437s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:46 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba 1G Jul 19 13:21:46 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:47 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7" returned: 0 in 0.449s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:47 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7 Jul 19 13:21:47 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:47 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7" returned: 0 in 0.300s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:47 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba 1G" returned: 0 in 0.512s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7" released by "delete_volume" :: held 0.815s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:47 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba Jul 19 13:21:47 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created reservations ['3143933a-0123-474c-a5f6-0e66bce315a9', 'd4f9722e-9ccf-4862-b41b-7527a8840313', '8f2e0747-0ebd-4e57-8b55-afcb5c4de543', '2b0eff2e-b730-49b9-9b2b-17a48f31094a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:47 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:47 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-65adf311-9777-48fc-941d-b0a65dc2cf2e-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:47 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba" returned: 0 in 0.329s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:47 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba is being set with open permissions: ugo+rw Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-65adf311-9777-48fc-941d-b0a65dc2cf2e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:47 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba Jul 19 13:21:47 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-quobyte-65adf311-9777-48fc-941d-b0a65dc2cf2e" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-65adf311-9777-48fc-941d-b0a65dc2cf2e" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[def7f1e7-77d8-4360-9106-ac909b3b5fdc]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:47 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.335s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:47 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Deleted volume successfully. Jul 19 13:21:47 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ebac3f9f-2bf8-45a4-8462-70d2bcb8f635 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-46b3ee6a-dc37-4f8a-a5f5-0af5ec10b8a7-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:47 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e Jul 19 13:21:47 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:48 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba" returned: 0 in 0.315s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:48 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.info Jul 19 13:21:48 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:48 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e" returned: 0 in 0.458s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:48 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e Jul 19 13:21:48 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:48 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.info" returned: 0 in 0.299s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:48 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.info is being set with open permissions: ugo+rw Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:48 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.info Jul 19 13:21:48 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:48 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-65adf311-9777-48fc-941d-b0a65dc2cf2e" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-65adf311-9777-48fc-941d-b0a65dc2cf2e" released by "delete_volume" :: held 0.771s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:48 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.info" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.523s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Creating offline snapshot 7078bd14-1343-4a2d-b359-00a6682a9e22 of volume 0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created reservations ['c35b95da-48f3-45ce-917b-db4c22c2c938', '358aba9f-1782-4d31-b72b-f4a8c4a543b8', '3daf40a2-9138-4744-9012-f935bf0cdfcd', '99ee915a-6f62-49b6-9bdc-bc626975a3f0'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:48 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-46a08145-7004-4355-be73-22136eef40de tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a5770b-b688-4cd3-81af-37ccdf7e650d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:48 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:48 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:48 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 Jul 19 13:21:48 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-0a02776e-e744-4848-8b5e-c4b47724f5ba-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-7550d313-c703-4a06-b36b-53f73133b22d-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-0a02776e-e744-4848-8b5e-c4b47724f5ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-170ecdec-aa6b-4a50-9a61-d87203c17e30" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:48 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-7550d313-c703-4a06-b36b-53f73133b22d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-170ecdec-aa6b-4a50-9a61-d87203c17e30" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-0a02776e-e744-4848-8b5e-c4b47724f5ba" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-0a02776e-e744-4848-8b5e-c4b47724f5ba" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot 0a02776e-e744-4848-8b5e-c4b47724f5ba of volume 170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-quobyte-7550d313-c703-4a06-b36b-53f73133b22d" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[69508eb7-05cd-4f6e-b96f-8199d5e173e8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-7550d313-c703-4a06-b36b-53f73133b22d" acquired by "delete_volume" :: waited 0.044s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1eb084-ef1e-49eb-aefe-2438ba864339]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:49 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.387s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:49 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Deleted volume successfully. Jul 19 13:21:49 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba Jul 19 13:21:49 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-997aac52-ab16-4e12-a517-fb3cb4dffd4f tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-65adf311-9777-48fc-941d-b0a65dc2cf2e-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:49 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564" returned: 0 in 0.613s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:49 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 1G Jul 19 13:21:49 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:49 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d Jul 19 13:21:49 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:49 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba" returned: 0 in 0.430s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-170ecdec-aa6b-4a50-9a61-d87203c17e30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83389ad1-74a4-45f3-969e-9300b9cd6c75]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:49 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d" returned: 0 in 0.480s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:49 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 Jul 19 13:21:49 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:49 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d Jul 19 13:21:49 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:49 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 1G" returned: 0 in 0.501s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:49 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 Jul 19 13:21:49 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:49 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-7550d313-c703-4a06-b36b-53f73133b22d" returned: 0 in 0.317s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:49 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30" returned: 0 in 0.445s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-7550d313-c703-4a06-b36b-53f73133b22d" released by "delete_volume" :: held 0.894s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:50 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba Jul 19 13:21:50 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created reservations ['2f2e5dac-42f1-43ce-8340-4c9fd82f49bf', 'f7bb85a0-d307-4998-876e-0c4e784939f8', 'b09feebe-139c-4b38-a535-56f9717b1e74', '4a2024ce-283f-4e4a-9937-9160fb7d27f7'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:50 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22" returned: 0 in 0.393s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:50 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 is being set with open permissions: ugo+rw Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:50 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:50 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:50 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 Jul 19 13:21:50 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:50 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba" returned: 0 in 0.459s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:50 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba Jul 19 13:21:50 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:50 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22" returned: 0 in 0.297s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:50 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=324,cinder:SELECT=234,cinder:DELETE=28,cinder:INSERT=81 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.336s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:50 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Deleted volume successfully. Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=243,cinder:UPDATE=305,cinder:INSERT=89,cinder:DELETE=30 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:21:50 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.info Jul 19 13:21:50 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e6e57971-e1c4-4622-9668-e31db86fa8d4 tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-7550d313-c703-4a06-b36b-53f73133b22d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:50 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30.0a02776e-e744-4848-8b5e-c4b47724f5ba" returned: 0 in 0.298s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-0a02776e-e744-4848-8b5e-c4b47724f5ba" released by "_delete_snapshot" :: held 1.759s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-170ecdec-aa6b-4a50-9a61-d87203c17e30" released by "delete_snapshot" :: held 1.804s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:50 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.info" returned: 0 in 0.316s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:50 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.info is being set with open permissions: ugo+rw Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:50 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.info Jul 19 13:21:50 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Created reservations ['6765ecab-7c30-41ad-a80f-a3c86e5c0995', 'a6193342-9ee6-4de7-bf43-7b2dac9c3d14', 'fbc220c4-7cf9-4868-ae0e-8d4ae38a1ce0', '4a4fb371-ddb5-4132-ad88-38f59932f702'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:50 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:21:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-e2f879d1-2205-4965-9926-930c428ae130 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-0a02776e-e744-4848-8b5e-c4b47724f5ba-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-170ecdec-aa6b-4a50-9a61-d87203c17e30-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-170ecdec-aa6b-4a50-9a61-d87203c17e30-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:51 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-170ecdec-aa6b-4a50-9a61-d87203c17e30" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.info" returned: 0 in 0.302s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-170ecdec-aa6b-4a50-9a61-d87203c17e30" acquired by "delete_volume" :: waited 0.044s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f539fe28-8e43-4245-a1e8-1911356a78d9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-35e04f7e-d065-4997-a9fd-b9604fdbf8d0-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:51 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-87891a38-dd25-4970-8044-ea1740aa531d tempest-ProjectReaderTests-907117873 None] Create snapshot completed successfully Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-35e04f7e-d065-4997-a9fd-b9604fdbf8d0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-quobyte-35e04f7e-d065-4997-a9fd-b9604fdbf8d0" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-35e04f7e-d065-4997-a9fd-b9604fdbf8d0" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-7078bd14-1343-4a2d-b359-00a6682a9e22-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db56c37-e0d0-47ce-9999-68c582ae389b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:51 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 Jul 19 13:21:51 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Lock "cinder-7078bd14-1343-4a2d-b359-00a6682a9e22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-0488a0c3-a05e-4327-be4b-f1a33eb7b564" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-0488a0c3-a05e-4327-be4b-f1a33eb7b564" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-7078bd14-1343-4a2d-b359-00a6682a9e22" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-7078bd14-1343-4a2d-b359-00a6682a9e22" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Deleting offline snapshot 7078bd14-1343-4a2d-b359-00a6682a9e22 of volume 0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] snapshot_file for this snap is: volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff47922-a986-40c8-bf52-9605b107fe34]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:51 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 Jul 19 13:21:51 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:51 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 Jul 19 13:21:51 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:51 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30" returned: 0 in 0.449s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:51 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30 Jul 19 13:21:51 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:51 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0" returned: 0 in 0.388s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:51 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0 Jul 19 13:21:51 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:51 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ee718-fda8-4012-b579-d9b82c27021a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:51 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-170ecdec-aa6b-4a50-9a61-d87203c17e30" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-170ecdec-aa6b-4a50-9a61-d87203c17e30" released by "delete_volume" :: held 0.791s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:52 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 Jul 19 13:21:52 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:52 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-35e04f7e-d065-4997-a9fd-b9604fdbf8d0" returned: 0 in 0.265s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-35e04f7e-d065-4997-a9fd-b9604fdbf8d0" released by "delete_volume" :: held 0.701s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Created reservations ['0ad580ac-033d-4c0a-8f51-16b5def5733f', '3973e5c8-f89f-4e8f-a496-069dfa6be985', 'e9ea0234-1a1e-4ce3-ac4b-4cf65c01a090', '3752a76d-1fd5-4c96-ba43-e0e20b41caf1'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created reservations ['7b09a81d-7067-4882-8368-b3ee77aeaa63', '96bb85a9-39bc-45f3-aea3-64c1159135a7', '668fb5de-3733-4989-a343-0c71544db6f8', 'e09db37d-7826-47e1-8e83-56d89af2fcaf'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:52 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:52 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:52 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:52 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:52 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564" returned: 0 in 0.436s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:52 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 Jul 19 13:21:52 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:52 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.345s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:52 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.450s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:52 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Deleted volume successfully. Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b9ffb9ff-31e0-42dd-8f70-8c0d2da92e5c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-35e04f7e-d065-4997-a9fd-b9604fdbf8d0-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:52 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-89372e28-6e7b-4eef-a12a-724f13a64cb5 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-170ecdec-aa6b-4a50-9a61-d87203c17e30-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-8174cea5-b439-4f1d-9ea4-78090aafa36d-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-8174cea5-b439-4f1d-9ea4-78090aafa36d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-quobyte-8174cea5-b439-4f1d-9ea4-78090aafa36d" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-8174cea5-b439-4f1d-9ea4-78090aafa36d" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:52 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8b968-188c-4d9b-b98d-3dc76667c59b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22" returned: 0 in 0.559s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:52 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22 Jul 19 13:21:52 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (044c4d07-7a31-4e73-8f38-2b5a874accdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8459f50d-9595-4159-8370-47e2f4c5c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8459f50d-9595-4159-8370-47e2f4c5c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929266886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdc8985-cbfd-4a2f-86d5-4cd303d38204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:53Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c16bda-2608-4321-81aa-e6d52b53e887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c16bda-2608-4321-81aa-e6d52b53e887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:53 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad022ec-24ce-4cd0-b86c-dd1cd414f0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:53 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad022ec-24ce-4cd0-b86c-dd1cd414f0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdc8985-cbfd-4a2f-86d5-4cd303d38204', 'volume_name': 'volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd64ec6-419f-4528-b384-8a3bff0630f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd64ec6-419f-4528-b384-8a3bff0630f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8040409-9fb3-4398-b365-8a6f29dee97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:53 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Volume 5bdc8985-cbfd-4a2f-86d5-4cd303d38204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204', 'volume_size': 1} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929266886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdc8985-cbfd-4a2f-86d5-4cd303d38204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:53Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Creating volume 5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:53 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:53 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 1073741824 Jul 19 13:21:53 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:53 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564.7078bd14-1343-4a2d-b359-00a6682a9e22" returned: 0 in 0.299s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-7078bd14-1343-4a2d-b359-00a6682a9e22" released by "_delete_snapshot" :: held 1.822s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-0488a0c3-a05e-4327-be4b-f1a33eb7b564" released by "delete_snapshot" :: held 1.856s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Created reservations ['281cafce-69c4-43af-a777-09a36685f9c4', 'ff01f67c-8637-48fc-8470-a458c80f5ea5', '59744b5c-aaa0-4237-8d58-806f94412212', '6da0f650-9fd3-4105-87bf-8d9ae4dba0e6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:53 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d" returned: 0 in 0.554s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:53 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d Jul 19 13:21:53 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Delete snapshot completed successfully. Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-d48e547d-bfe9-491c-90a2-263723c9cf0e tempest-ProjectReaderTests-907117873 None] Lock "cinder-7078bd14-1343-4a2d-b359-00a6682a9e22-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:53 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 1073741824" returned: 0 in 0.559s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:53 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 Jul 19 13:21:53 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:53 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-8174cea5-b439-4f1d-9ea4-78090aafa36d" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-8174cea5-b439-4f1d-9ea4-78090aafa36d" released by "delete_volume" :: held 0.880s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-0488a0c3-a05e-4327-be4b-f1a33eb7b564-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Lock "cinder-0488a0c3-a05e-4327-be4b-f1a33eb7b564-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created reservations ['fb75102d-f1c7-4bf4-9e71-6bf3e22fa2a6', '9bd60715-9e9f-4a2b-9a9d-2a171cd4dcd2', '13de9719-e368-4855-8dbf-4c46ab620fc5', '82590c03-4861-4f45-9eab-9300f1cc03b2'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-0488a0c3-a05e-4327-be4b-f1a33eb7b564" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-0488a0c3-a05e-4327-be4b-f1a33eb7b564" acquired by "delete_volume" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c86683d-5686-49bd-9c39-0c267f2a8e17]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:53 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:53 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:53 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" returned: 0 in 0.320s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8040409-9fb3-4398-b365-8a6f29dee97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9298604-04ec-4188-88c9-17fa6bce4c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:54 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 Jul 19 13:21:54 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:54 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Volume volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 (5bdc8985-cbfd-4a2f-86d5-4cd303d38204): created successfully Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9298604-04ec-4188-88c9-17fa6bce4c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (044c4d07-7a31-4e73-8f38-2b5a874accdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f7a8b7fc-ed59-4f20-ba0b-68d58685eae3 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "cinder-quobyte-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5" acquired by "delete_volume" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0d5818-5d35-437d-97f5-5df3c1395f9a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:54 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.290s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Deleted volume successfully. Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-598d919a-d56c-4db2-92f9-7878248c2c0c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-8174cea5-b439-4f1d-9ea4-78090aafa36d-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:54 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 Jul 19 13:21:54 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:54 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564" returned: 0 in 0.441s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:54 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564 Jul 19 13:21:54 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:54 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5" returned: 0 in 0.398s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:54 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5 Jul 19 13:21:54 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:54 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0488a0c3-a05e-4327-be4b-f1a33eb7b564" returned: 0 in 0.265s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-0488a0c3-a05e-4327-be4b-f1a33eb7b564" released by "delete_volume" :: held 0.779s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Created reservations ['24036477-4d04-48c8-9e14-ead8d980a007', 'e9a57abd-23d1-4d4d-8086-87e3651dc9fe', 'b6627edf-b378-4db2-beb1-eb096535c647', '2b3524fa-4e1b-4290-8a8d-2af52ed6a9c4'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:54 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:54 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:54 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5" returned: 0 in 0.287s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-quobyte-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5" released by "delete_volume" :: held 0.729s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Created reservations ['483aaad2-f462-44ea-bd92-f3645fd10b20', '2e6b8649-08ca-488f-95a3-8edcff1bcb21', '86311c38-6371-4ece-855c-5e75fdac32e3', '9789c94b-4728-44f5-bb06-06471a6902f9'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:55 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.281s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:55 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:21:55 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Deleted volume successfully. Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3cb45cc4-45e3-41da-b481-1879f8a8d3bf tempest-ProjectReaderTests-907117873 None] Lock "cinder-0488a0c3-a05e-4327-be4b-f1a33eb7b564-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:55 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.289s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:21:55 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Deleted volume successfully. Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-db22b02b-f495-45c4-9aa2-0e101efc0a2c tempest-CreateVolumesFromSourceVolumeTest-773541516 None] Lock "cinder-68de7caa-6db6-49d6-baf6-5e8f6ba9f5d5-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot b36ca46b-bb20-400b-802f-ac8acd09a959 of volume 5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (46b061ae-b4f3-4521-83b6-a211fa490788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555efe30-da5f-4946-9acd-8630a1c07f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[880273c9-6a0a-4e7d-ab4e-8f7690377878]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555efe30-da5f-4946-9acd-8630a1c07f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084793639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbb7be-7395-4fb0-8c80-848d8cd012a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:56Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5ede68-3845-4941-8ed5-2b9794845ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5ede68-3845-4941-8ed5-2b9794845ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6942654-17ff-41f3-9f08-40c3b1e10fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6942654-17ff-41f3-9f08-40c3b1e10fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcbb7be-7395-4fb0-8c80-848d8cd012a8', 'volume_name': 'volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3dd766-746c-434c-9802-c580e616e04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3dd766-746c-434c-9802-c580e616e04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c72cf0-e511-4c23-b700-728fcc40641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:55 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Volume 9bcbb7be-7395-4fb0-8c80-848d8cd012a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8', 'volume_size': 1} Jul 19 13:21:55 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:55 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 Jul 19 13:21:55 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:56 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" returned: 0 in 0.384s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:56 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 1G Jul 19 13:21:56 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:56 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 1G" returned: 0 in 0.510s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:56 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:56 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 Jul 19 13:21:56 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:57 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959" returned: 0 in 0.316s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:57 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 is being set with open permissions: ugo+rw Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:57 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 Jul 19 13:21:57 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:57 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:57 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.info Jul 19 13:21:57 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:57 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.info" returned: 0 in 0.265s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:57 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.info is being set with open permissions: ugo+rw Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:57 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.info Jul 19 13:21:57 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:57 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.info" returned: 0 in 0.292s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.018s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084793639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbb7be-7395-4fb0-8c80-848d8cd012a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:21:56Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Creating volume 9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:21:57 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:21:57 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:57 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 1073741824 Jul 19 13:21:57 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:57 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-5ddc1178-f41e-49de-80c1-eb898c748fc5 tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:21:58 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 1073741824" returned: 0 in 0.522s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:58 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 Jul 19 13:21:58 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:58 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c72cf0-e511-4c23-b700-728fcc40641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee382558-3f16-4d6a-ad8b-201083971cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-b36ca46b-bb20-400b-802f-ac8acd09a959-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:58 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Volume volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 (9bcbb7be-7395-4fb0-8c80-848d8cd012a8): created successfully Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee382558-3f16-4d6a-ad8b-201083971cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (46b061ae-b4f3-4521-83b6-a211fa490788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Lock "cinder-b36ca46b-bb20-400b-802f-ac8acd09a959-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:58 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-9821a8dc-0c61-45b2-89ec-d301420b68b9 tempest-ProjectReaderTests-907117873 None] Created volume successfully. Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-b36ca46b-bb20-400b-802f-ac8acd09a959" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-b36ca46b-bb20-400b-802f-ac8acd09a959" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot b36ca46b-bb20-400b-802f-ac8acd09a959 of volume 5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5df99a-b720-401e-beb3-91d5cd5e3fa2]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:58 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:59 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 Jul 19 13:21:59 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:59 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959" returned: 0 in 0.386s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:59 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:21:59 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[423e66c7-b0aa-4ea7-9014-892cd670e930]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:21:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:59 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 Jul 19 13:21:59 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:21:59 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 19 13:21:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" returned: 0 in 0.432s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:21:59 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:21:59 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 Jul 19 13:21:59 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Creating offline snapshot 79ad40d6-efe8-4a27-91c3-9a09ca83aa98 of volume 9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d15c7-a3e5-49d7-81c9-d45d31b3b7f6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:00 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 Jul 19 13:22:00 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:00 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959" returned: 0 in 0.498s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:00 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959 Jul 19 13:22:00 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:00 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" returned: 0 in 0.467s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:00 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 1G Jul 19 13:22:00 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:00 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204.b36ca46b-bb20-400b-802f-ac8acd09a959" returned: 0 in 0.331s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-b36ca46b-bb20-400b-802f-ac8acd09a959" released by "_delete_snapshot" :: held 1.763s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" released by "delete_snapshot" :: held 1.791s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Created reservations ['2ccbfae3-fd8d-4d81-9352-9fa0516a7b61', 'f61a9634-d5e7-4ba0-a0b9-92d215f49637', '2ceb5090-d297-45dd-a3e9-8c467c27023e', 'baa8ad37-df95-4b93-8137-4946bd7aaa80'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:00 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:22:00 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-194610a6-1097-4047-bc6a-e4c9b9fc67ff tempest-ProjectMemberTests-2078871870 None] Lock "cinder-b36ca46b-bb20-400b-802f-ac8acd09a959-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-5bdc8985-cbfd-4a2f-86d5-4cd303d38204-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-5bdc8985-cbfd-4a2f-86d5-4cd303d38204-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:01 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 1G" returned: 0 in 0.625s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd930ac2-d860-44c1-8d42-827c33afbeab]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:01 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 Jul 19 13:22:01 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:01 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 Jul 19 13:22:01 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:01 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98" returned: 0 in 0.428s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:01 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 is being set with open permissions: ugo+rw Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:01 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 Jul 19 13:22:01 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:01 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" returned: 0 in 0.525s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:01 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204 Jul 19 13:22:01 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:01 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:01 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:01 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.info Jul 19 13:22:01 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:02 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" returned: 0 in 0.286s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-5bdc8985-cbfd-4a2f-86d5-4cd303d38204" released by "delete_volume" :: held 0.894s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Created reservations ['a1e5640d-30f0-42e0-8c4d-23bddd6c42f8', '5f78e482-01bc-430e-8117-302717a65047', 'ea4686ed-f03b-4adf-b9e7-04c47ce63bc0', 'ccf55c23-44d2-48a1-b235-6654f62d6d2b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:02 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.info" returned: 0 in 0.327s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:02 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.info is being set with open permissions: ugo+rw Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:02 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.info Jul 19 13:22:02 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:02 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:02 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:02 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.info" returned: 0 in 0.290s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:02 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-49ed93c3-2bf9-4b47-bb8b-1828961d04b9 tempest-ProjectReaderTests-907117873 None] Create snapshot completed successfully Jul 19 13:22:02 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.339s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:02 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:22:02 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-02f0b9ff-8dfb-4e22-b9a6-183f2bc91592 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-5bdc8985-cbfd-4a2f-86d5-4cd303d38204-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-79ad40d6-efe8-4a27-91c3-9a09ca83aa98-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Lock "cinder-79ad40d6-efe8-4a27-91c3-9a09ca83aa98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-79ad40d6-efe8-4a27-91c3-9a09ca83aa98" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-79ad40d6-efe8-4a27-91c3-9a09ca83aa98" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Deleting offline snapshot 79ad40d6-efe8-4a27-91c3-9a09ca83aa98 of volume 9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] snapshot_file for this snap is: volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac64a45c-69e6-418d-a90a-a3c4b2309d3f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:03 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 Jul 19 13:22:03 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:03 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98" returned: 0 in 0.529s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a82600-f1ef-4e07-be68-0e5b2cd2dd91]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:03 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (124624c6-103e-4296-8ee8-ab1367329e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1949a159-77f5-4d47-a9c4-d7ddfc39c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:04 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 Jul 19 13:22:04 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1949a159-77f5-4d47-a9c4-d7ddfc39c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148678523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c81f4-4385-4986-b604-3c222344a544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:04Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0a57f4-8a8c-4f64-af74-df0e159f172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0a57f4-8a8c-4f64-af74-df0e159f172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f794dc1-9fd4-4693-87c2-23a81ed42655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f794dc1-9fd4-4693-87c2-23a81ed42655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344c81f4-4385-4986-b604-3c222344a544', 'volume_name': 'volume-344c81f4-4385-4986-b604-3c222344a544', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd01856-0385-44b3-a7f7-48f69fb6d8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd01856-0385-44b3-a7f7-48f69fb6d8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f08ef5c-ce81-4818-ab6a-bf8d91e411f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:04 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Volume 344c81f4-4385-4986-b604-3c222344a544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344c81f4-4385-4986-b604-3c222344a544', 'volume_size': 1} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148678523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c81f4-4385-4986-b604-3c222344a544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:04Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Creating volume 344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:04 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:04 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 1073741824 Jul 19 13:22:04 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:04 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" returned: 0 in 0.493s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:04 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 Jul 19 13:22:04 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:04 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 1073741824" returned: 0 in 0.579s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:04 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 Jul 19 13:22:04 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:04 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98" returned: 0 in 0.431s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:04 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:04 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98 Jul 19 13:22:04 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:05 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544" returned: 0 in 0.294s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f08ef5c-ce81-4818-ab6a-bf8d91e411f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344c81f4-4385-4986-b604-3c222344a544', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53114031-b3d8-4e02-987a-f9390e00f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:05 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Volume volume-344c81f4-4385-4986-b604-3c222344a544 (344c81f4-4385-4986-b604-3c222344a544): created successfully Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53114031-b3d8-4e02-987a-f9390e00f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (124624c6-103e-4296-8ee8-ab1367329e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:05 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-999bba77-4843-46ba-a817-091b1f095a50 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:22:05 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8.79ad40d6-efe8-4a27-91c3-9a09ca83aa98" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-79ad40d6-efe8-4a27-91c3-9a09ca83aa98" released by "_delete_snapshot" :: held 1.866s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" released by "delete_snapshot" :: held 1.904s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Created reservations ['55ce348e-da5e-4f1b-8c70-8ce74b5c059b', 'cf0fc3e4-b9ec-4ff6-acb9-daaf481dfc67', 'aafc4775-fbf7-4407-a470-363ec1e80150', '73b776da-607b-4793-a31d-003ff0ff5697'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:05 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Delete snapshot completed successfully. Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-76995c6b-09f3-4895-be5e-24499e278973 tempest-ProjectReaderTests-907117873 None] Lock "cinder-79ad40d6-efe8-4a27-91c3-9a09ca83aa98-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-9bcbb7be-7395-4fb0-8c80-848d8cd012a8-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-9bcbb7be-7395-4fb0-8c80-848d8cd012a8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc012513-6715-46b1-9b0d-fc957595c68a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:05 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:05 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 Jul 19 13:22:05 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:06 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" returned: 0 in 0.423s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:06 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8 Jul 19 13:22:06 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:06 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" returned: 0 in 0.304s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-9bcbb7be-7395-4fb0-8c80-848d8cd012a8" released by "delete_volume" :: held 0.802s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Created reservations ['fd32c0bd-328b-41b0-b49e-d0d26d2b0b62', '914a98e9-f121-4813-aa0a-9449c2fc9501', 'b90ac61a-d925-4fd6-a74d-c0af6358061c', 'c03f6566-786d-49ae-82bf-af39c0192301'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:06 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:06 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot 93cbc93e-d2b0-46c6-b95a-0feb1915416f of volume 344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[443bbfb9-6df2-4e94-91a2-538ce014ba05]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:06 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 Jul 19 13:22:06 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:06 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.332s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:06 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Deleted volume successfully. Jul 19 13:22:06 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-1b3cb0d6-b473-40e6-858a-1f0c9f79b3b6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-9bcbb7be-7395-4fb0-8c80-848d8cd012a8-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:07 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544" returned: 0 in 0.426s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:07 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f 1G Jul 19 13:22:07 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (a659e331-8cbc-4849-969f-fcf918328ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d88d07-48e6-4697-bab2-74f4ad4a5b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d88d07-48e6-4697-bab2-74f4ad4a5b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634505141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042f3e87-44a0-4166-a187-fb31d4211517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:07Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb66f77a-fa5e-4e4f-9ae3-ea7cb27a263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb66f77a-fa5e-4e4f-9ae3-ea7cb27a263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2547fa3-119a-473a-bc14-4a0fdd0af136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2547fa3-119a-473a-bc14-4a0fdd0af136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042f3e87-44a0-4166-a187-fb31d4211517', 'volume_name': 'volume-042f3e87-44a0-4166-a187-fb31d4211517', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171c86fe-3a0d-491c-9eda-ba7d4f8e3233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171c86fe-3a0d-491c-9eda-ba7d4f8e3233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fb24f6-176b-4b35-81dd-571d1eb690d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:07 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Volume 042f3e87-44a0-4166-a187-fb31d4211517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042f3e87-44a0-4166-a187-fb31d4211517', 'volume_size': 1} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:07 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f 1G" returned: 0 in 0.551s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:07 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c81f4-4385-4986-b604-3c222344a544 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:07 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c81f4-4385-4986-b604-3c222344a544 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f Jul 19 13:22:07 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:07 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c81f4-4385-4986-b604-3c222344a544 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f" returned: 0 in 0.354s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:08 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f is being set with open permissions: ugo+rw Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:08 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f Jul 19 13:22:08 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:08 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f" returned: 0 in 0.275s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:08 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.info Jul 19 13:22:08 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:08 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.info" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:08 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.info is being set with open permissions: ugo+rw Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:08 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.info Jul 19 13:22:08 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:08 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.info" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634505141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042f3e87-44a0-4166-a187-fb31d4211517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:07Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Creating volume 042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:08 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:08 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:08 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 1073741824 Jul 19 13:22:08 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:08 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3dacd6fe-7f33-467c-9e18-b3b5aa94ee5d tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:22:09 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 1073741824" returned: 0 in 0.525s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:09 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 Jul 19 13:22:09 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-93cbc93e-d2b0-46c6-b95a-0feb1915416f-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Lock "cinder-93cbc93e-d2b0-46c6-b95a-0feb1915416f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-344c81f4-4385-4986-b604-3c222344a544" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-344c81f4-4385-4986-b604-3c222344a544" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-93cbc93e-d2b0-46c6-b95a-0feb1915416f" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-93cbc93e-d2b0-46c6-b95a-0feb1915416f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot 93cbc93e-d2b0-46c6-b95a-0feb1915416f of volume 344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:09 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517" returned: 0 in 0.333s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55bf351-4363-4d8b-85e6-b813b411e258]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fb24f6-176b-4b35-81dd-571d1eb690d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042f3e87-44a0-4166-a187-fb31d4211517', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34849e0d-b433-448c-97c7-1ed00856fde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:09 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Volume volume-042f3e87-44a0-4166-a187-fb31d4211517 (042f3e87-44a0-4166-a187-fb31d4211517): created successfully Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34849e0d-b433-448c-97c7-1ed00856fde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:09 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (a659e331-8cbc-4849-969f-fcf918328ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:09 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-41a91f8e-4890-43ad-a409-8d9e1ae99594 tempest-ProjectReaderTests-907117873 None] Created volume successfully. Jul 19 13:22:09 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f Jul 19 13:22:09 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:10 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f" returned: 0 in 0.425s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-344c81f4-4385-4986-b604-3c222344a544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a47030-1906-402e-a147-6756a5e7eff4]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:10 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 Jul 19 13:22:10 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:10 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544" returned: 0 in 0.392s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:10 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f Jul 19 13:22:10 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Creating offline snapshot 0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 of volume 042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac5752-d700-47c5-b3cb-678107f98b4f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:10 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:10 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 Jul 19 13:22:10 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:11 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f" returned: 0 in 0.397s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:11 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f Jul 19 13:22:11 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:11 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544.93cbc93e-d2b0-46c6-b95a-0feb1915416f" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:11 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517" returned: 0 in 0.460s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-93cbc93e-d2b0-46c6-b95a-0feb1915416f" released by "_delete_snapshot" :: held 1.630s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-344c81f4-4385-4986-b604-3c222344a544" released by "delete_snapshot" :: held 1.662s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:11 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 1G Jul 19 13:22:11 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Created reservations ['c2d59893-67f2-4191-ba95-a5c79c1213bd', '2f66061d-1f29-46cb-940b-de20e689cf66', 'a5c21f3d-d73d-4b1f-9677-fc3503949d59', '2126e0c9-0f53-4aa4-a1b6-ec93adbc0b0a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:11 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f4266572-60ef-4058-bcc2-161abd4a9ade tempest-ProjectMemberTests-2078871870 None] Lock "cinder-93cbc93e-d2b0-46c6-b95a-0feb1915416f-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:11 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 1G" returned: 0 in 0.404s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042f3e87-44a0-4166-a187-fb31d4211517 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:11 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042f3e87-44a0-4166-a187-fb31d4211517 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 Jul 19 13:22:11 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-344c81f4-4385-4986-b604-3c222344a544-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Lock "cinder-344c81f4-4385-4986-b604-3c222344a544-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-344c81f4-4385-4986-b604-3c222344a544" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-344c81f4-4385-4986-b604-3c222344a544" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e103442-bd63-4148-822f-34e1e4bb4fa5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:11 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:12 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042f3e87-44a0-4166-a187-fb31d4211517 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" returned: 0 in 0.328s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:12 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 is being set with open permissions: ugo+rw Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:12 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 Jul 19 13:22:12 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:12 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 Jul 19 13:22:12 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:12 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:12 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.info Jul 19 13:22:12 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:12 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544" returned: 0 in 0.412s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:12 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544 Jul 19 13:22:12 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:12 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.info" returned: 0 in 0.296s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:12 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.info is being set with open permissions: ugo+rw Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:12 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-344c81f4-4385-4986-b604-3c222344a544" returned: 0 in 0.279s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:12 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.info Jul 19 13:22:12 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-344c81f4-4385-4986-b604-3c222344a544" released by "delete_volume" :: held 0.760s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Created reservations ['4eedee31-5892-4b18-ba1e-d91af2e2d8c7', 'c911b9f8-27d3-4c7d-af9b-876f6b72bdea', '1d829abf-f9d7-4494-b1af-5bbfa64019ce', 'f8d2aa22-e36f-453a-b56c-9c480c561348'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:12 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:12 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:12 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.info" returned: 0 in 0.276s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:12 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:12 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-e9ee1d26-a841-4b19-8b7a-01a3352e4f96 tempest-ProjectReaderTests-907117873 None] Create snapshot completed successfully Jul 19 13:22:13 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.289s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:13 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b78b4da1-fe8f-4524-a807-cca154510d0c tempest-ProjectMemberTests-2078871870 None] Lock "cinder-344c81f4-4385-4986-b604-3c222344a544-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (ec624c41-ca00-4cab-a54a-9caf3fac0cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0524b20-9962-4488-a9b5-bff96e8607d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0524b20-9962-4488-a9b5-bff96e8607d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929354885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a9458-8380-49e2-9c33-bb9ddae4f916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:14Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7def739d-82ed-4f79-ba20-81f735aef17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7def739d-82ed-4f79-ba20-81f735aef17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7b1a49-d156-4fed-9964-1e664418da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7b1a49-d156-4fed-9964-1e664418da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8a9458-8380-49e2-9c33-bb9ddae4f916', 'volume_name': 'volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9146e7d8-de0c-48e0-9e2b-cf4b8583c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9146e7d8-de0c-48e0-9e2b-cf4b8583c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b53c75-b422-40cc-a244-ff0fc9d6ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:13 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Volume 0c8a9458-8380-49e2-9c33-bb9ddae4f916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916', 'volume_size': 1} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929354885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a9458-8380-49e2-9c33-bb9ddae4f916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:14Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Creating volume 0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:13 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:13 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:13 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 1073741824 Jul 19 13:22:13 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-0882e3fd-3d94-4a0c-ab6b-b1337b51abf3-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Lock "cinder-0882e3fd-3d94-4a0c-ab6b-b1337b51abf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-042f3e87-44a0-4166-a187-fb31d4211517" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-042f3e87-44a0-4166-a187-fb31d4211517" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:14 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Deleting offline snapshot 0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 of volume 042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] snapshot_file for this snap is: volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 1073741824" returned: 0 in 0.464s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9410832-6325-48aa-8263-6a4691092e5b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:14 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 Jul 19 13:22:14 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:14 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 Jul 19 13:22:14 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:14 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916" returned: 0 in 0.283s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b53c75-b422-40cc-a244-ff0fc9d6ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6f08a4-61d8-4fa2-910f-1068017875a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Volume volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 (0c8a9458-8380-49e2-9c33-bb9ddae4f916): created successfully Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6f08a4-61d8-4fa2-910f-1068017875a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:14 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (ec624c41-ca00-4cab-a54a-9caf3fac0cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" returned: 0 in 0.399s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-042f3e87-44a0-4166-a187-fb31d4211517(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:14 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ff5cc039-15d7-4b78-a0fe-5589a10a9266 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[588524d2-aa23-4137-b4f2-2746ffbe8815]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:14 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 Jul 19 13:22:14 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:14 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517" returned: 0 in 0.384s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:14 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 Jul 19 13:22:14 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:15 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:15 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3 Jul 19 13:22:15 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:15 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517.0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" returned: 0 in 0.273s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-0882e3fd-3d94-4a0c-ab6b-b1337b51abf3" released by "_delete_snapshot" :: held 1.538s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-042f3e87-44a0-4166-a187-fb31d4211517" released by "delete_snapshot" :: held 1.569s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Created reservations ['e1910377-a6f0-4cac-8504-5ff1a3d5dc55', '05ce73bd-1ae2-44b1-acc9-9b775a3d2cfe', '260ef5bf-34cf-4790-ba9d-13ca58bfe21d', '97767cd3-4d55-472e-898a-95b17b832c3b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Delete snapshot completed successfully. Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot fc8996dc-ff59-4918-b898-128a9d73a51d of volume 0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-46808b6f-7bae-4845-b9da-91cf4707959a tempest-ProjectReaderTests-907117873 None] Lock "cinder-0882e3fd-3d94-4a0c-ab6b-b1337b51abf3-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddb417f-f5aa-4063-9ea9-63060fbd76c9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:15 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 Jul 19 13:22:15 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:16 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916" returned: 0 in 0.352s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:16 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d 1G Jul 19 13:22:16 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-042f3e87-44a0-4166-a187-fb31d4211517-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Lock "cinder-042f3e87-44a0-4166-a187-fb31d4211517-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-042f3e87-44a0-4166-a187-fb31d4211517" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-042f3e87-44a0-4166-a187-fb31d4211517" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c856ae-f696-49ce-aa40-ae67b95a263e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:16 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 Jul 19 13:22:16 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:16 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d 1G" returned: 0 in 0.445s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:16 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d Jul 19 13:22:16 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:16 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517" returned: 0 in 0.385s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:16 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517 Jul 19 13:22:16 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:16 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d" returned: 0 in 0.351s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:16 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d is being set with open permissions: ugo+rw Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:16 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-042f3e87-44a0-4166-a187-fb31d4211517" returned: 0 in 0.282s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:16 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d Jul 19 13:22:16 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-042f3e87-44a0-4166-a187-fb31d4211517" released by "delete_volume" :: held 0.734s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Created reservations ['8586680c-090a-4eee-827e-7328ea2db70d', '977464dd-cc81-4cea-ae3c-349df081620b', 'c3e6b039-41c2-43e2-8df4-7abe07362c13', '15e7a700-60c3-45a2-abe6-f6ef69fda02a'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:17 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:17 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:17 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:17 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.info Jul 19 13:22:17 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:17 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.288s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Deleted volume successfully. Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f43c0ac3-ee90-424a-8862-bf4710602960 tempest-ProjectReaderTests-907117873 None] Lock "cinder-042f3e87-44a0-4166-a187-fb31d4211517-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:17 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.info" returned: 0 in 0.272s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:17 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.info is being set with open permissions: ugo+rw Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:17 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.info Jul 19 13:22:17 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:17 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.info" returned: 0 in 0.313s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d78fe6c9-e84c-4328-af99-bb1aa95fc7df tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (d7aed746-2435-4c90-bd72-44db51f38b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702e7595-05a7-43fd-a736-6db302fde38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702e7595-05a7-43fd-a736-6db302fde38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147487804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9636b5-a22a-4109-8a55-9ea83fe7a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:18Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d7871c-d1a8-4071-9eb0-35118b11af46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d7871c-d1a8-4071-9eb0-35118b11af46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d7d9c-7fd8-4fba-8925-ac0caa76387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d7d9c-7fd8-4fba-8925-ac0caa76387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9636b5-a22a-4109-8a55-9ea83fe7a035', 'volume_name': 'volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:17 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08b20fe-7286-4ca4-899c-584a898d28d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08b20fe-7286-4ca4-899c-584a898d28d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4093d0-e7c4-44e4-820a-207005b270ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Volume 6b9636b5-a22a-4109-8a55-9ea83fe7a035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035', 'volume_size': 1} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147487804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9636b5-a22a-4109-8a55-9ea83fe7a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078142fc864c43d78fbb838286004014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:18Z,use_quota=True,user_id='f841932ab1a8457e8caadf9cbe66f7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Creating volume 6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:18 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:18 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 1073741824 Jul 19 13:22:18 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:18 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 1073741824" returned: 0 in 0.461s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:18 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 Jul 19 13:22:18 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:18 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035" returned: 0 in 0.249s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4093d0-e7c4-44e4-820a-207005b270ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c72aae-0a97-4ab1-a5e2-92203bad31c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Volume volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 (6b9636b5-a22a-4109-8a55-9ea83fe7a035): created successfully Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c72aae-0a97-4ab1-a5e2-92203bad31c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Flow 'volume_create_manager' (d7aed746-2435-4c90-bd72-44db51f38b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:18 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-55a105d3-ee1e-4970-a436-437f3db3a680 tempest-ProjectReaderTests-907117873 None] Created volume successfully. Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-fc8996dc-ff59-4918-b898-128a9d73a51d-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-fc8996dc-ff59-4918-b898-128a9d73a51d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-0c8a9458-8380-49e2-9c33-bb9ddae4f916" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-0c8a9458-8380-49e2-9c33-bb9ddae4f916" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-fc8996dc-ff59-4918-b898-128a9d73a51d" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-fc8996dc-ff59-4918-b898-128a9d73a51d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot fc8996dc-ff59-4918-b898-128a9d73a51d of volume 0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c9fe0-e19d-483e-b463-ca741acb54ce]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:19 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d Jul 19 13:22:19 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:19 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d" returned: 0 in 0.355s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7868b-fa77-4024-a63e-c26b6ec91099]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:19 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 Jul 19 13:22:19 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:19 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916" returned: 0 in 0.359s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:19 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d Jul 19 13:22:19 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Creating offline snapshot d6dd3d11-0492-47c6-a9b2-d30eb3d20539 of volume 6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[524dcd67-8ac5-49db-8554-53621f95ec2c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:20 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d" returned: 0 in 0.398s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:20 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d Jul 19 13:22:20 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:20 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 Jul 19 13:22:20 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:20 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916.fc8996dc-ff59-4918-b898-128a9d73a51d" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-fc8996dc-ff59-4918-b898-128a9d73a51d" released by "_delete_snapshot" :: held 1.456s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-0c8a9458-8380-49e2-9c33-bb9ddae4f916" released by "delete_snapshot" :: held 1.479s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:20 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035" returned: 0 in 0.363s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Created reservations ['54d7d1a0-e094-4090-8cd0-29a2a1a2f5e4', 'a80293bf-7974-4620-a05d-e888f0b1f56c', 'dba49a0d-2b4d-4333-90a5-24061f8de4fb', '5181544b-9d72-4de7-bd0b-bae55537b222'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:20 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 1G Jul 19 13:22:20 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:20 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-67e8b825-6fb5-4855-88e2-da745627ad68 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-fc8996dc-ff59-4918-b898-128a9d73a51d-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:20 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 1G" returned: 0 in 0.383s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:20 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:20 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 Jul 19 13:22:20 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-0c8a9458-8380-49e2-9c33-bb9ddae4f916-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-0c8a9458-8380-49e2-9c33-bb9ddae4f916-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-0c8a9458-8380-49e2-9c33-bb9ddae4f916" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-0c8a9458-8380-49e2-9c33-bb9ddae4f916" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:21 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539" returned: 0 in 0.320s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:21 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 is being set with open permissions: ugo+rw Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93bf7f-8404-4c6b-9093-a53165967167]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:21 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 Jul 19 13:22:21 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:21 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 Jul 19 13:22:21 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:21 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539" returned: 0 in 0.239s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:21 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.info Jul 19 13:22:21 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:21 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:21 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916 Jul 19 13:22:21 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:21 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.info" returned: 0 in 0.249s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:21 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.info is being set with open permissions: ugo+rw Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:21 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.info Jul 19 13:22:21 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:21 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0c8a9458-8380-49e2-9c33-bb9ddae4f916" returned: 0 in 0.248s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-0c8a9458-8380-49e2-9c33-bb9ddae4f916" released by "delete_volume" :: held 0.677s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Created reservations ['88e2c95d-91c9-4d9e-ad5b-b61a39dfe72f', 'c3fa370f-b17d-4ea0-b7db-f2347ef39565', '03b935e4-e926-4ff5-a7f5-92ae0fbb3aa6', '83006ff7-6d78-4081-a38b-472d361d521b'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:21 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:22 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.info" returned: 0 in 0.280s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:22 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:22 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-04702a27-1b53-4251-a096-71d0166608a9 tempest-ProjectReaderTests-907117873 None] Create snapshot completed successfully Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-d6dd3d11-0492-47c6-a9b2-d30eb3d20539-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:22 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.337s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-d6dd3d11-0492-47c6-a9b2-d30eb3d20539-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-6b9636b5-a22a-4109-8a55-9ea83fe7a035" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:22 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-6b9636b5-a22a-4109-8a55-9ea83fe7a035" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-d6dd3d11-0492-47c6-a9b2-d30eb3d20539" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3c5f9b08-6cc6-4194-b6cb-fc2bca406595 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-0c8a9458-8380-49e2-9c33-bb9ddae4f916-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-d6dd3d11-0492-47c6-a9b2-d30eb3d20539" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Deleting offline snapshot d6dd3d11-0492-47c6-a9b2-d30eb3d20539 of volume 6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] snapshot_file for this snap is: volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e5b8ae-6f19-4032-b589-49faf630bb25]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:22 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 Jul 19 13:22:22 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:22 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (f861e9eb-5eef-4f17-ad05-d65bd7c40c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569c7a04-3418-4560-b665-f9992156e906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539" returned: 0 in 0.410s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569c7a04-3418-4560-b665-f9992156e906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317450350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65053c9-9f12-46de-b104-d7c8d98e3210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:23Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5333c489-29ad-4cfb-9e53-d75d556e2c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5333c489-29ad-4cfb-9e53-d75d556e2c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142ea6eb-ccdf-4838-81fb-64c550febf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142ea6eb-ccdf-4838-81fb-64c550febf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65053c9-9f12-46de-b104-d7c8d98e3210', 'volume_name': 'volume-d65053c9-9f12-46de-b104-d7c8d98e3210', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124ac02b-4de3-4583-bc63-edb05bb48990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124ac02b-4de3-4583-bc63-edb05bb48990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75da4b95-70db-45a1-888c-dfd8e2282a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:22 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Volume d65053c9-9f12-46de-b104-d7c8d98e3210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65053c9-9f12-46de-b104-d7c8d98e3210', 'volume_size': 1} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317450350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65053c9-9f12-46de-b104-d7c8d98e3210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:23Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Creating volume d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:22 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f340434-5ce4-48c6-97ab-f8db687d6826]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:22 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:22 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 1073741824 Jul 19 13:22:22 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:23 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 Jul 19 13:22:23 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:23 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:23 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 Jul 19 13:22:23 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:23 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 1073741824" returned: 0 in 0.434s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:23 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 Jul 19 13:22:23 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:23 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539" returned: 0 in 0.335s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:23 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:23 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539 Jul 19 13:22:23 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75da4b95-70db-45a1-888c-dfd8e2282a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65053c9-9f12-46de-b104-d7c8d98e3210', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f931828-9ee3-4a6f-8733-7c565b58cca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:23 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Volume volume-d65053c9-9f12-46de-b104-d7c8d98e3210 (d65053c9-9f12-46de-b104-d7c8d98e3210): created successfully Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f931828-9ee3-4a6f-8733-7c565b58cca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (f861e9eb-5eef-4f17-ad05-d65bd7c40c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:23 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b68bf3d6-5282-4e0f-8631-efa79f4ac7d1 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:22:23 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035.d6dd3d11-0492-47c6-a9b2-d30eb3d20539" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-d6dd3d11-0492-47c6-a9b2-d30eb3d20539" released by "_delete_snapshot" :: held 1.567s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-6b9636b5-a22a-4109-8a55-9ea83fe7a035" released by "delete_snapshot" :: held 1.595s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot 3d953616-8727-48f7-9d49-11d39161577c of volume d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38055c3-10a3-4ccb-888b-59e6973a4c9f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Created reservations ['c6ce5e2a-7700-49d1-baf1-6059a7c6089d', '60e24623-b58e-40c1-85ca-a19252c9ec18', 'eb0c2a97-5def-4ffc-b96a-204daa3ffb06', '05c52b0a-ebcc-492f-ab81-d602d16412c6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Delete snapshot completed successfully. Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-91ccbbaa-3d37-4ee9-b73d-8e08972714f6 tempest-ProjectReaderTests-907117873 None] Lock "cinder-d6dd3d11-0492-47c6-a9b2-d30eb3d20539-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:24 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 Jul 19 13:22:24 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:24 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210" returned: 0 in 0.357s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:24 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c 1G Jul 19 13:22:24 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-6b9636b5-a22a-4109-8a55-9ea83fe7a035-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Lock "cinder-6b9636b5-a22a-4109-8a55-9ea83fe7a035-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Acquiring lock "cinder-quobyte-6b9636b5-a22a-4109-8a55-9ea83fe7a035" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-6b9636b5-a22a-4109-8a55-9ea83fe7a035" acquired by "delete_volume" :: waited 0.013s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dea5a9-f259-4150-b768-ca453f3884f6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:24 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 Jul 19 13:22:24 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:24 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c 1G" returned: 0 in 0.408s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d65053c9-9f12-46de-b104-d7c8d98e3210 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:24 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d65053c9-9f12-46de-b104-d7c8d98e3210 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c Jul 19 13:22:24 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:24 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035" returned: 0 in 0.364s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:25 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035 Jul 19 13:22:25 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:25 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d65053c9-9f12-46de-b104-d7c8d98e3210 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c" returned: 0 in 0.285s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:25 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c is being set with open permissions: ugo+rw Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:25 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c Jul 19 13:22:25 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:25 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-6b9636b5-a22a-4109-8a55-9ea83fe7a035" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Lock "cinder-quobyte-6b9636b5-a22a-4109-8a55-9ea83fe7a035" released by "delete_volume" :: held 0.682s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Created reservations ['07174fb7-ec0c-4bc0-99ce-1c3ee0cb78cb', '0a4002a3-cdb9-4cd8-9564-a6e75f5d348e', '1902535d-3578-49d3-b269-e98cdb34145b', 'eea1ab22-77c4-4d24-a080-aa2c2abae3d3'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:25 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c" returned: 0 in 0.247s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:25 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.info Jul 19 13:22:25 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:25 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:25 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:25 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.info" returned: 0 in 0.256s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:25 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.info is being set with open permissions: ugo+rw Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:25 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:25 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.info Jul 19 13:22:25 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Deleted volume successfully. Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-ec8883ed-7251-4e66-a483-6cd84fe1f018 tempest-ProjectReaderTests-907117873 None] Lock "cinder-6b9636b5-a22a-4109-8a55-9ea83fe7a035-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:25 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.info" returned: 0 in 0.260s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:25 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d62ac118-5ede-4057-9494-f12f10da92f7 tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-3d953616-8727-48f7-9d49-11d39161577c-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-3d953616-8727-48f7-9d49-11d39161577c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-d65053c9-9f12-46de-b104-d7c8d98e3210" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-d65053c9-9f12-46de-b104-d7c8d98e3210" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-3d953616-8727-48f7-9d49-11d39161577c" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-3d953616-8727-48f7-9d49-11d39161577c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot 3d953616-8727-48f7-9d49-11d39161577c of volume d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5575d71-4513-4158-b96e-38bf4909dc6c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:26 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c Jul 19 13:22:26 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:26 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c" returned: 0 in 0.395s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d65053c9-9f12-46de-b104-d7c8d98e3210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[076afb8c-6ccc-4f56-8cbd-7d1eda87ce98]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:26 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 Jul 19 13:22:26 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:27 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210" returned: 0 in 0.363s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:27 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c Jul 19 13:22:27 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:27 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c" returned: 0 in 0.358s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:27 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c Jul 19 13:22:27 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:27 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210.3d953616-8727-48f7-9d49-11d39161577c" returned: 0 in 0.262s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-3d953616-8727-48f7-9d49-11d39161577c" released by "_delete_snapshot" :: held 1.500s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-d65053c9-9f12-46de-b104-d7c8d98e3210" released by "delete_snapshot" :: held 1.531s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Created reservations ['2869158c-9ba5-4398-8109-bbd78b85b74e', 'be9ddc22-7e48-4f64-b16f-c89b5d3e5ea8', 'd10a54e8-db60-4f7f-b31a-fcb247c918d1', 'f9ea89d7-756a-48ca-8158-527e03720afe'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:27 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:22:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-17a2ab84-6314-4105-8779-5a538e32ebd1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-3d953616-8727-48f7-9d49-11d39161577c-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-d65053c9-9f12-46de-b104-d7c8d98e3210-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-d65053c9-9f12-46de-b104-d7c8d98e3210-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-d65053c9-9f12-46de-b104-d7c8d98e3210" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-d65053c9-9f12-46de-b104-d7c8d98e3210" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f1b700-b0be-44f4-aa36-f90781cc9628]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:28 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 Jul 19 13:22:28 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:28 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210" returned: 0 in 0.391s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:28 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210 Jul 19 13:22:28 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:29 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d65053c9-9f12-46de-b104-d7c8d98e3210" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-d65053c9-9f12-46de-b104-d7c8d98e3210" released by "delete_volume" :: held 0.709s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Created reservations ['27fc41bf-35b9-40f3-b1f2-423ad137cbaa', '22472562-2071-485e-84a3-72c824b68eb3', 'fb5914b4-dfe5-42c7-80cf-86d069e59743', 'fda6b72c-7775-4d9d-8bfd-03aa42512d90'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:29 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:29 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:29 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.277s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-11fd1674-bc47-4416-ba26-ab727283a8f6 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-d65053c9-9f12-46de-b104-d7c8d98e3210-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (0353e24b-767a-407f-91dc-c21f0de44891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:29 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441aefde-67dc-411a-b6b2-b8bd0c07a9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441aefde-67dc-411a-b6b2-b8bd0c07a9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971484418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef67fb80-7f85-4145-a43f-0b0de12cacff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:30Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014886cd-402d-4733-9433-1c4561241a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014886cd-402d-4733-9433-1c4561241a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f938de5-ff5e-49e0-9aa4-7c417e4f1d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f938de5-ff5e-49e0-9aa4-7c417e4f1d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef67fb80-7f85-4145-a43f-0b0de12cacff', 'volume_name': 'volume-ef67fb80-7f85-4145-a43f-0b0de12cacff', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d634b7-2f1c-4f7d-8f87-56c24a3d7989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d634b7-2f1c-4f7d-8f87-56c24a3d7989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1bca9e-0b08-432a-a088-ac61038c36a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Volume ef67fb80-7f85-4145-a43f-0b0de12cacff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef67fb80-7f85-4145-a43f-0b0de12cacff', 'volume_size': 1} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971484418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef67fb80-7f85-4145-a43f-0b0de12cacff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:30Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Creating volume ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:30 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:30 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff 1073741824 Jul 19 13:22:30 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:30 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff 1073741824" returned: 0 in 0.442s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:30 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff Jul 19 13:22:30 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:30 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff" returned: 0 in 0.250s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1bca9e-0b08-432a-a088-ac61038c36a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef67fb80-7f85-4145-a43f-0b0de12cacff', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6a8ef8-69f3-4048-ac86-dae5ccccebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:30 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Volume volume-ef67fb80-7f85-4145-a43f-0b0de12cacff (ef67fb80-7f85-4145-a43f-0b0de12cacff): created successfully Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6a8ef8-69f3-4048-ac86-dae5ccccebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:30 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (0353e24b-767a-407f-91dc-c21f0de44891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:30 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-1f7d2c39-3179-440e-aba9-13dcdd5b0a73 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot 1af14be5-10ca-4737-99ed-cd6c608d1931 of volume ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea4abf-0f72-427f-8cd1-383da6103b3c]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:31 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff Jul 19 13:22:31 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:31 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:31 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 1G Jul 19 13:22:31 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:31 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 1G" returned: 0 in 0.443s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:31 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef67fb80-7f85-4145-a43f-0b0de12cacff -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:32 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef67fb80-7f85-4145-a43f-0b0de12cacff -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 Jul 19 13:22:32 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:32 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef67fb80-7f85-4145-a43f-0b0de12cacff -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931" returned: 0 in 0.310s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:32 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 is being set with open permissions: ugo+rw Jul 19 13:22:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:32 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 Jul 19 13:22:32 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:32 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931" returned: 0 in 0.254s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:32 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.info Jul 19 13:22:32 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:32 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.info" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:32 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.info is being set with open permissions: ugo+rw Jul 19 13:22:32 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:32 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.info Jul 19 13:22:32 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:33 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.info" returned: 0 in 0.247s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:33 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-bf50d36d-c265-47c3-b65a-5a08e34836a5 tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-1af14be5-10ca-4737-99ed-cd6c608d1931-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-1af14be5-10ca-4737-99ed-cd6c608d1931-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-ef67fb80-7f85-4145-a43f-0b0de12cacff" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-ef67fb80-7f85-4145-a43f-0b0de12cacff" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-1af14be5-10ca-4737-99ed-cd6c608d1931" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-1af14be5-10ca-4737-99ed-cd6c608d1931" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot 1af14be5-10ca-4737-99ed-cd6c608d1931 of volume ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c90b58-9ea3-40b1-b64a-ce1328db7843]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:33 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 Jul 19 13:22:33 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:33 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931" returned: 0 in 0.361s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef67fb80-7f85-4145-a43f-0b0de12cacff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1787ccd5-424c-4f75-a9e9-cc047f2423bb]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:33 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff Jul 19 13:22:33 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:33 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (015b70b1-a08e-4b72-b500-044f8a37f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252943c1-59ca-4499-a44d-a0f164b30e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252943c1-59ca-4499-a44d-a0f164b30e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971488452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ec768-fd5e-4662-9be2-7a723e5b421d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:34Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc31ade-7b1f-4292-9f3f-bfd59d1a4bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc31ade-7b1f-4292-9f3f-bfd59d1a4bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2180fa27-99ba-49a2-9467-7d59883b1d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2180fa27-99ba-49a2-9467-7d59883b1d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15ec768-fd5e-4662-9be2-7a723e5b421d', 'volume_name': 'volume-d15ec768-fd5e-4662-9be2-7a723e5b421d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d0819-39aa-4535-acaa-2a7430708884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d0819-39aa-4535-acaa-2a7430708884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe76913c-2adb-4dd5-ab2e-cedd45cd68e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:34 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Volume d15ec768-fd5e-4662-9be2-7a723e5b421d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15ec768-fd5e-4662-9be2-7a723e5b421d', 'volume_size': 1} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971488452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ec768-fd5e-4662-9be2-7a723e5b421d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:34Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Creating volume d15ec768-fd5e-4662-9be2-7a723e5b421d {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:34 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:34 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d 1073741824 Jul 19 13:22:34 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:34 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff" returned: 0 in 0.368s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:34 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 Jul 19 13:22:34 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:34 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d 1073741824" returned: 0 in 0.418s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:34 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931" returned: 0 in 0.353s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:34 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931 Jul 19 13:22:34 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:34 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d Jul 19 13:22:34 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:34 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff.1af14be5-10ca-4737-99ed-cd6c608d1931" returned: 0 in 0.244s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-1af14be5-10ca-4737-99ed-cd6c608d1931" released by "_delete_snapshot" :: held 1.420s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:34 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-ef67fb80-7f85-4145-a43f-0b0de12cacff" released by "delete_snapshot" :: held 1.444s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe76913c-2adb-4dd5-ab2e-cedd45cd68e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15ec768-fd5e-4662-9be2-7a723e5b421d', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e538c3-0c98-475b-8d3b-d047049fec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:34 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Volume volume-d15ec768-fd5e-4662-9be2-7a723e5b421d (d15ec768-fd5e-4662-9be2-7a723e5b421d): created successfully Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e538c3-0c98-475b-8d3b-d047049fec13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (015b70b1-a08e-4b72-b500-044f8a37f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3e0f7150-f89e-4908-b94a-be9fd6a60f1d tempest-ProjectReaderTests-1884050758 None] Created volume successfully. Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Created reservations ['5cb52a0d-8f21-4863-b272-29dff1af9823', '99eed105-e8a0-4f6a-a79d-678ace278748', '2ca0c1fc-e49f-4388-971b-0ad444bf5549', 'bff468d9-4931-458d-a016-48065c013a47'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:34 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:22:34 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-fb4d4d88-f6bf-46ce-9ea9-f2ff2cdbf6f1 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-1af14be5-10ca-4737-99ed-cd6c608d1931-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-d15ec768-fd5e-4662-9be2-7a723e5b421d-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-d15ec768-fd5e-4662-9be2-7a723e5b421d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-quobyte-d15ec768-fd5e-4662-9be2-7a723e5b421d" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-d15ec768-fd5e-4662-9be2-7a723e5b421d" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dde7a94-8f36-4607-a237-0c7e17bfa127]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:35 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d Jul 19 13:22:35 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-ef67fb80-7f85-4145-a43f-0b0de12cacff-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Lock "cinder-ef67fb80-7f85-4145-a43f-0b0de12cacff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-ef67fb80-7f85-4145-a43f-0b0de12cacff" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-ef67fb80-7f85-4145-a43f-0b0de12cacff" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9abce-dc3e-4470-8ee9-0680fb25c7e5]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:35 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d" returned: 0 in 0.374s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:35 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d Jul 19 13:22:35 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:35 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff Jul 19 13:22:35 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:35 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d15ec768-fd5e-4662-9be2-7a723e5b421d" returned: 0 in 0.259s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-d15ec768-fd5e-4662-9be2-7a723e5b421d" released by "delete_volume" :: held 0.682s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:35 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff" returned: 0 in 0.365s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:35 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff Jul 19 13:22:35 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:35 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Created reservations ['cc040a45-a5f9-4e65-93d3-e4f6ae567c1b', '5da4e260-af73-4889-9ddf-32e7ded12d83', '9b19cc73-b477-47a9-8e12-e962dee54e46', '031f7a2a-a37b-44c0-b703-9dad99c2bf8e'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:36 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:36 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:36 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-ef67fb80-7f85-4145-a43f-0b0de12cacff" returned: 0 in 0.250s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-ef67fb80-7f85-4145-a43f-0b0de12cacff" released by "delete_volume" :: held 0.676s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Created reservations ['fc378fec-e058-44cb-b495-656114b27a12', 'bc75c939-8123-49f1-b359-e526755c3eb4', '9e7512b2-aa66-4217-b8f8-90ddf8293344', '6a9b9695-8b5f-44ea-a2c0-7f1cd052f645'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:36 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.259s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Deleted volume successfully. Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c0fa3d2b-7ee6-4953-ac2c-6d9b0923de50 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-d15ec768-fd5e-4662-9be2-7a723e5b421d-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:36 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:36 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:36 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.274s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:36 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-b23b5f6a-ad40-4333-a21d-e273b7369bec tempest-ProjectMemberTests-2078871870 None] Lock "cinder-ef67fb80-7f85-4145-a43f-0b0de12cacff-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (051f88eb-c5a9-4b9e-9834-1282f166196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e911ee-c62b-4c62-a0e4-519c3b2916c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e911ee-c62b-4c62-a0e4-519c3b2916c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991780119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d2d4eb-94c0-4d58-8e43-48f7959ade88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:37Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f6717e-3167-4226-82a8-37164df4f8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f6717e-3167-4226-82a8-37164df4f8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a636787-747c-460d-8b5b-580884d12729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a636787-747c-460d-8b5b-580884d12729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d2d4eb-94c0-4d58-8e43-48f7959ade88', 'volume_name': 'volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02626a2f-3f2e-4557-b50b-f477f507a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02626a2f-3f2e-4557-b50b-f477f507a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76741a8d-3069-4cc1-a529-5818040453f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:36 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Volume 72d2d4eb-94c0-4d58-8e43-48f7959ade88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88', 'volume_size': 1} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991780119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d2d4eb-94c0-4d58-8e43-48f7959ade88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:37Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Creating volume 72d2d4eb-94c0-4d58-8e43-48f7959ade88 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:36 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:36 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:36 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 1073741824 Jul 19 13:22:36 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (46a54d28-2a75-4f50-9ab2-031eadfa8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722bac3b-5bb5-42dc-8daf-4ed1a3b12e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722bac3b-5bb5-42dc-8daf-4ed1a3b12e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773000813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ab79f-c697-492d-b9a7-4216202c54f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:37Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c12b83f-afde-415e-94ca-106f7217869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c12b83f-afde-415e-94ca-106f7217869a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de590b2e-a3e1-44c3-afb0-4d0b3efdf48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de590b2e-a3e1-44c3-afb0-4d0b3efdf48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01ab79f-c697-492d-b9a7-4216202c54f2', 'volume_name': 'volume-a01ab79f-c697-492d-b9a7-4216202c54f2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae7a848-fc4e-406f-a66c-c14785889f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae7a848-fc4e-406f-a66c-c14785889f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1df9746-2367-423e-9cf8-fb6a00e64962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:37 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Volume a01ab79f-c697-492d-b9a7-4216202c54f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01ab79f-c697-492d-b9a7-4216202c54f2', 'volume_size': 1} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:37 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 1073741824" returned: 0 in 0.404s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:37 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 Jul 19 13:22:37 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:37 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773000813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ab79f-c697-492d-b9a7-4216202c54f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967f0c33eee4dca874232d968ef78b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:37Z,use_quota=True,user_id='84b42fb91fd04c678b36bf5aba1a476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Creating volume a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:37 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76741a8d-3069-4cc1-a529-5818040453f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:37 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 1073741824 Jul 19 13:22:37 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a40a81-4fc2-40a6-9999-0dd4f2fa45e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:37 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Volume volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 (72d2d4eb-94c0-4d58-8e43-48f7959ade88): created successfully Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a40a81-4fc2-40a6-9999-0dd4f2fa45e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (051f88eb-c5a9-4b9e-9834-1282f166196b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:37 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-a9076c99-ad82-4f42-8f3a-cfe6f3d6a316 tempest-ProjectReaderTests-1884050758 None] Created volume successfully. Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-72d2d4eb-94c0-4d58-8e43-48f7959ade88-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-72d2d4eb-94c0-4d58-8e43-48f7959ade88-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-quobyte-72d2d4eb-94c0-4d58-8e43-48f7959ade88" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-72d2d4eb-94c0-4d58-8e43-48f7959ade88" acquired by "delete_volume" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f31310a-7b4e-400a-8bfc-649f7055bd87]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:37 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:38 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 Jul 19 13:22:38 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:38 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 1073741824" returned: 0 in 0.483s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:38 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 Jul 19 13:22:38 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:38 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88" returned: 0 in 0.376s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:38 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88 Jul 19 13:22:38 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:38 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2" returned: 0 in 0.251s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1df9746-2367-423e-9cf8-fb6a00e64962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01ab79f-c697-492d-b9a7-4216202c54f2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea8764d-d87d-423a-abe6-5322e777ba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:38 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Volume volume-a01ab79f-c697-492d-b9a7-4216202c54f2 (a01ab79f-c697-492d-b9a7-4216202c54f2): created successfully Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea8764d-d87d-423a-abe6-5322e777ba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Flow 'volume_create_manager' (46a54d28-2a75-4f50-9ab2-031eadfa8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f9fcadb6-4755-4139-840c-06dcb2e07a49 tempest-ProjectMemberTests-2078871870 None] Created volume successfully. Jul 19 13:22:38 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-72d2d4eb-94c0-4d58-8e43-48f7959ade88" returned: 0 in 0.246s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-72d2d4eb-94c0-4d58-8e43-48f7959ade88" released by "delete_volume" :: held 0.660s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Created reservations ['f3654ec1-3a63-4da9-a10b-9f9554ab750f', '1983708a-607e-4b6a-8c34-d0ef92462ec4', '3af20d2f-f352-4b1e-a8f6-58bbed0d1fd7', '1590f448-5e1a-426a-b348-8542668a2c31'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:38 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:38 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:38 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.242s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:38 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Deleted volume successfully. Jul 19 13:22:38 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-6335821f-7278-4a53-a1e0-1e9ed8db22e3 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-72d2d4eb-94c0-4d58-8e43-48f7959ade88-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Creating offline snapshot 6ed25648-92e2-4a10-a8f2-84b175348991 of volume a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (c69c64cd-52e2-4455-840a-b3ba83ab93db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e17a8f0-84e9-4cc1-9c4a-e7047f586ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59b3f0c-8ce9-40f6-9cd9-456cc01fca1a]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e17a8f0-84e9-4cc1-9c4a-e7047f586ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730019974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19221561-7dad-4c60-834f-541dc6a26c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:40Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd185f65-45f0-4994-a409-94f0e684450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd185f65-45f0-4994-a409-94f0e684450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a90b30-22a3-45b2-8405-3d0ad7033c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a90b30-22a3-45b2-8405-3d0ad7033c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19221561-7dad-4c60-834f-541dc6a26c7c', 'volume_name': 'volume-19221561-7dad-4c60-834f-541dc6a26c7c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e1bdc7-bbaa-4336-8717-4e57cf1ef854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e1bdc7-bbaa-4336-8717-4e57cf1ef854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645f3de0-a9a3-4968-ad7b-fb1a42bd597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:39 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Volume 19221561-7dad-4c60-834f-541dc6a26c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19221561-7dad-4c60-834f-541dc6a26c7c', 'volume_size': 1} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:39 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 Jul 19 13:22:39 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:39 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2" returned: 0 in 0.347s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:39 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:39 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 1G Jul 19 13:22:39 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:40 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 1G" returned: 0 in 0.388s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01ab79f-c697-492d-b9a7-4216202c54f2 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:40 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01ab79f-c697-492d-b9a7-4216202c54f2 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 Jul 19 13:22:40 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:40 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01ab79f-c697-492d-b9a7-4216202c54f2 -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991" returned: 0 in 0.295s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:40 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 is being set with open permissions: ugo+rw Jul 19 13:22:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:40 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 Jul 19 13:22:40 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:40 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:40 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:40 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.info Jul 19 13:22:40 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:41 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.info" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:41 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.info is being set with open permissions: ugo+rw Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:41 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.info Jul 19 13:22:41 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:41 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.info" returned: 0 in 0.242s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730019974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19221561-7dad-4c60-834f-541dc6a26c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:40Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Creating volume 19221561-7dad-4c60-834f-541dc6a26c7c {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:41 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:41 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c 1073741824 Jul 19 13:22:41 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:41 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-90a559e0-be91-4b3c-9bce-17574d91fb04 tempest-ProjectMemberTests-2078871870 None] Create snapshot completed successfully Jul 19 13:22:41 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c 1073741824" returned: 0 in 0.409s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:41 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:41 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c Jul 19 13:22:41 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:42 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c" returned: 0 in 0.235s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645f3de0-a9a3-4968-ad7b-fb1a42bd597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19221561-7dad-4c60-834f-541dc6a26c7c', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7374f10c-c08b-43d0-8575-68cbce6cb3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:42 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Volume volume-19221561-7dad-4c60-834f-541dc6a26c7c (19221561-7dad-4c60-834f-541dc6a26c7c): created successfully Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7374f10c-c08b-43d0-8575-68cbce6cb3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (c69c64cd-52e2-4455-840a-b3ba83ab93db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:42 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-405878c2-b5a0-4827-b353-fd330b388bf7 tempest-ProjectReaderTests-1884050758 None] Created volume successfully. Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:42 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:42 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-6ed25648-92e2-4a10-a8f2-84b175348991-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-6ed25648-92e2-4a10-a8f2-84b175348991-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-a01ab79f-c697-492d-b9a7-4216202c54f2" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-a01ab79f-c697-492d-b9a7-4216202c54f2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-6ed25648-92e2-4a10-a8f2-84b175348991" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-6ed25648-92e2-4a10-a8f2-84b175348991" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Deleting offline snapshot 6ed25648-92e2-4a10-a8f2-84b175348991 of volume a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] snapshot_file for this snap is: volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-19221561-7dad-4c60-834f-541dc6a26c7c-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:42 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.259s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc22bed-f7b7-4bf4-ad14-d93f2bf59e7d]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 29 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-19221561-7dad-4c60-834f-541dc6a26c7c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-quobyte-19221561-7dad-4c60-834f-541dc6a26c7c" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-19221561-7dad-4c60-834f-541dc6a26c7c" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a82fc-a044-45f5-99ce-4982c586e2a8]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:42 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 Jul 19 13:22:42 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:42 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c Jul 19 13:22:42 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:43 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991" returned: 0 in 0.373s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01ab79f-c697-492d-b9a7-4216202c54f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb08b2-d0f7-42a1-bfb9-c6076da90fe9]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:43 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c" returned: 0 in 0.354s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:43 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c Jul 19 13:22:43 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:43 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 Jul 19 13:22:43 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:43 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-19221561-7dad-4c60-834f-541dc6a26c7c" returned: 0 in 0.250s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-19221561-7dad-4c60-834f-541dc6a26c7c" released by "delete_volume" :: held 0.650s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:43 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Created reservations ['023d3d41-88f6-4f15-8aa0-2f679177934e', 'dd4d597b-889e-4fe9-bb12-3e6c2d98b744', 'f57a4cd5-c565-4e80-ac5e-9168544536c7', '69cd3b03-1984-42e6-b42b-6c6bde0c30a8'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2" returned: 0 in 0.380s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:43 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 Jul 19 13:22:43 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:43 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:43 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:43 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:43 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Deleted volume successfully. Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-c34337ff-775a-46f5-bf83-aba7383caab4 tempest-ProjectReaderTests-1884050758 None] Lock "cinder-19221561-7dad-4c60-834f-541dc6a26c7c-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:43 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991" returned: 0 in 0.371s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:43 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:43 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991 Jul 19 13:22:43 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:44 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2.6ed25648-92e2-4a10-a8f2-84b175348991" returned: 0 in 0.263s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-6ed25648-92e2-4a10-a8f2-84b175348991" released by "_delete_snapshot" :: held 1.511s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-a01ab79f-c697-492d-b9a7-4216202c54f2" released by "delete_snapshot" :: held 1.533s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Created reservations ['d0f4ae5b-b139-4c3f-97ec-e30ea617952d', '415e9727-6f74-4b10-a83c-a9e371783408', 'da4c1322-f367-488b-9f4b-666dbd535a68', 'e298d8d4-4cbe-49e5-a560-d378f5f988ff'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (ee96a464-2ec7-4e50-a4bb-1e85bf69f12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e9b8b2-0205-44a6-b802-6357e094737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e9b8b2-0205-44a6-b802-6357e094737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167106319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:44Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a49821b-4322-459d-bbf8-97a4946cff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a49821b-4322-459d-bbf8-97a4946cff79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667551d6-0073-45c4-ba08-62fc295cc8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667551d6-0073-45c4-ba08-62fc295cc8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2', 'volume_name': 'volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cc9802-9d3c-4549-a8ae-4596606108de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cc9802-9d3c-4549-a8ae-4596606108de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ecfa5b-cef0-4aa9-b89e-e901aba93886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:44 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Volume 66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2', 'volume_size': 1} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167106319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946d4f68d75648ff87bc55d94f449122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:44Z,use_quota=True,user_id='b69b51bde4564fc6ab80f5a20b7800e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Creating volume 66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:44 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:44 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Delete snapshot completed successfully. Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-edb4a7e7-fcdf-4a9e-8593-c3508f0bb305 tempest-ProjectMemberTests-2078871870 None] Lock "cinder-6ed25648-92e2-4a10-a8f2-84b175348991-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:44 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 1073741824 Jul 19 13:22:44 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-a01ab79f-c697-492d-b9a7-4216202c54f2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Lock "cinder-a01ab79f-c697-492d-b9a7-4216202c54f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:44 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Acquiring lock "cinder-quobyte-a01ab79f-c697-492d-b9a7-4216202c54f2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 1073741824" returned: 0 in 0.449s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-a01ab79f-c697-492d-b9a7-4216202c54f2" acquired by "delete_volume" :: waited 0.024s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465b83e-cd89-4f5f-aa7e-f38158235a03]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:44 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:44 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 Jul 19 13:22:44 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:45 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 Jul 19 13:22:45 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:45 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ecfa5b-cef0-4aa9-b89e-e901aba93886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5897906-6bf4-4217-b0fb-8dee9cb815ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:45 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Volume volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 (66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2): created successfully Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5897906-6bf4-4217-b0fb-8dee9cb815ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Flow 'volume_create_manager' (ee96a464-2ec7-4e50-a4bb-1e85bf69f12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-8591df17-39d9-4242-86a3-c457e5b3cf7b tempest-ProjectReaderTests-1884050758 None] Created volume successfully. Jul 19 13:22:45 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2" returned: 0 in 0.372s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:45 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2 Jul 19 13:22:45 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Lock "cinder-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Acquiring lock "cinder-quobyte-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4e12ea-061e-45a3-a09c-cd7834d575c6]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:45 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-a01ab79f-c697-492d-b9a7-4216202c54f2" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:45 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 Jul 19 13:22:45 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Lock "cinder-quobyte-a01ab79f-c697-492d-b9a7-4216202c54f2" released by "delete_volume" :: held 0.688s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Created reservations ['efad0ffe-429f-4f6c-b3a5-767f43db486c', '315e5a79-94f4-4db6-9b34-15d7a332ba32', 'b53870d4-c72d-4f04-ab13-0a2bb8ad0b67', '35cf1446-76fd-43bd-8936-7e7378e623aa'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:45 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:45 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:45 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2" returned: 0 in 0.363s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:45 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2 Jul 19 13:22:45 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:45 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.257s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:45 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Deleted volume successfully. Jul 19 13:22:45 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-cd4fe8ab-8dc6-4094-b098-c4981d140a7e tempest-ProjectMemberTests-2078871870 None] Lock "cinder-a01ab79f-c697-492d-b9a7-4216202c54f2-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:46 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2" returned: 0 in 0.248s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Lock "cinder-quobyte-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2" released by "delete_volume" :: held 0.648s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Created reservations ['774cfab0-ce45-4d82-9523-621403f51924', 'a50f3740-a3d2-43b1-b3b3-0dd1473ca05c', '41f1ed0c-3c62-474b-9913-6d3c48bb8031', '9850ab0b-7e4b-4083-adca-65036c1b5382'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:46 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:46 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:46 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.253s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:46 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Deleted volume successfully. Jul 19 13:22:46 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-3565fe5e-f978-41d9-b2ba-c8230443697b tempest-ProjectReaderTests-1884050758 None] Lock "cinder-66b4b006-a2d9-4e1a-b6c1-f957dc2f31b2-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Flow 'volume_create_manager' (cacf8e81-53ef-4e1b-aa36-70c7b788a9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a71732c-a941-447a-ae94-4685e66911cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a71732c-a941-447a-ae94-4685e66911cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492550973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0040853b-7a6b-4a7d-968e-6914c4770230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54da08bc34d74e8fb48c95871cdb5689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:50Z,use_quota=True,user_id='fcd195a11ebb4fe389183528b0c8f38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0af2c83-ac44-4c69-adb1-8a373783e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0af2c83-ac44-4c69-adb1-8a373783e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f661c4-3636-450b-9d48-1c5da639d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f661c4-3636-450b-9d48-1c5da639d426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0040853b-7a6b-4a7d-968e-6914c4770230', 'volume_name': 'volume-0040853b-7a6b-4a7d-968e-6914c4770230', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f55a92-989e-4421-b63e-e4a4229bb0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f55a92-989e-4421-b63e-e4a4229bb0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adfcc49-4ae7-4230-8f1f-49385d2dd741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:49 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Volume 0040853b-7a6b-4a7d-968e-6914c4770230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0040853b-7a6b-4a7d-968e-6914c4770230', 'volume_size': 1} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492550973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0040853b-7a6b-4a7d-968e-6914c4770230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54da08bc34d74e8fb48c95871cdb5689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:50Z,use_quota=True,user_id='fcd195a11ebb4fe389183528b0c8f38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Creating volume 0040853b-7a6b-4a7d-968e-6914c4770230 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:49 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:49 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:49 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 1073741824 Jul 19 13:22:49 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:50 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 1073741824" returned: 0 in 0.407s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:50 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 Jul 19 13:22:50 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:50 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adfcc49-4ae7-4230-8f1f-49385d2dd741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0040853b-7a6b-4a7d-968e-6914c4770230', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abb7bf3-7b5a-4636-b70a-e88cab509afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:50 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Volume volume-0040853b-7a6b-4a7d-968e-6914c4770230 (0040853b-7a6b-4a7d-968e-6914c4770230): created successfully Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abb7bf3-7b5a-4636-b70a-e88cab509afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Flow 'volume_create_manager' (cacf8e81-53ef-4e1b-aa36-70c7b788a9d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:50 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-98de0dc9-cb32-4c9f-b0eb-1a59be1c5d29 tempest-ProjectReaderTests-1992271573 None] Created volume successfully. Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "cinder-0040853b-7a6b-4a7d-968e-6914c4770230-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-0040853b-7a6b-4a7d-968e-6914c4770230-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=195,cinder:INSERT=68,cinder:UPDATE=256,cinder:DELETE=16 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=188,cinder:INSERT=71,cinder:UPDATE=267,cinder:DELETE=26 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "cinder-quobyte-0040853b-7a6b-4a7d-968e-6914c4770230" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-quobyte-0040853b-7a6b-4a7d-968e-6914c4770230" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef9ff1-3549-4b37-b0b3-067f28e4056e]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:50 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:50 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 Jul 19 13:22:50 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:51 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230" returned: 0 in 0.348s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:51 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230 Jul 19 13:22:51 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:51 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-0040853b-7a6b-4a7d-968e-6914c4770230" returned: 0 in 0.235s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-quobyte-0040853b-7a6b-4a7d-968e-6914c4770230" released by "delete_volume" :: held 0.619s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Created reservations ['ee57b22c-3719-43dd-b5f1-78903ed9a913', '294983f4-b83e-4f2e-9ad2-b8e02d2a49a7', 'f61a6a98-5f36-45c7-ad71-c6e4578452fd', '0bd8bc46-128f-49b9-9b70-e456168ed152'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:51 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:51 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:51 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.237s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:51 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Deleted volume successfully. Jul 19 13:22:51 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7b3d1aa7-c770-4cb5-bbb6-34350014f0a3 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-0040853b-7a6b-4a7d-968e-6914c4770230-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Flow 'volume_create_manager' (e5f9d443-2222-47e4-9e45-6eaa764c54d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed1b30e-0751-48d9-8f48-efb40caa27e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed1b30e-0751-48d9-8f48-efb40caa27e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727304166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199de732-86e1-4245-9f99-863bcab905d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54da08bc34d74e8fb48c95871cdb5689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:52Z,use_quota=True,user_id='fcd195a11ebb4fe389183528b0c8f38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da99111f-8ab4-4cdf-8079-3a570b372a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da99111f-8ab4-4cdf-8079-3a570b372a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a09b6c-dca7-455e-aab6-8d118cdd9235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a09b6c-dca7-455e-aab6-8d118cdd9235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199de732-86e1-4245-9f99-863bcab905d3', 'volume_name': 'volume-199de732-86e1-4245-9f99-863bcab905d3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3694b65e-754d-4ba3-bcd5-771c032a39c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3694b65e-754d-4ba3-bcd5-771c032a39c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65806fa9-a34b-44b8-82dc-cefd650792f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:52 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Volume 199de732-86e1-4245-9f99-863bcab905d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199de732-86e1-4245-9f99-863bcab905d3', 'volume_size': 1} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727304166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199de732-86e1-4245-9f99-863bcab905d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54da08bc34d74e8fb48c95871cdb5689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:22:52Z,use_quota=True,user_id='fcd195a11ebb4fe389183528b0c8f38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Creating volume 199de732-86e1-4245-9f99-863bcab905d3 {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:22:52 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:52 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 1073741824 Jul 19 13:22:52 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:52 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 1073741824" returned: 0 in 0.415s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:52 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:52 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 Jul 19 13:22:52 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:53 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3" returned: 0 in 0.244s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65806fa9-a34b-44b8-82dc-cefd650792f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199de732-86e1-4245-9f99-863bcab905d3', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b03e91-5ced-43bb-9618-aa7b6f474f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:22:53 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Volume volume-199de732-86e1-4245-9f99-863bcab905d3 (199de732-86e1-4245-9f99-863bcab905d3): created successfully Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b03e91-5ced-43bb-9618-aa7b6f474f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Flow 'volume_create_manager' (e5f9d443-2222-47e4-9e45-6eaa764c54d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:22:53 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-d35717ee-b65d-4756-9d86-f905f277db00 tempest-ProjectReaderTests-1992271573 None] Created volume successfully. Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "cinder-199de732-86e1-4245-9f99-863bcab905d3-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-199de732-86e1-4245-9f99-863bcab905d3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "cinder-quobyte-199de732-86e1-4245-9f99-863bcab905d3" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-quobyte-199de732-86e1-4245-9f99-863bcab905d3" acquired by "delete_volume" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8880c5-820c-43c2-a6d2-097e493dfb74]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:53 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 Jul 19 13:22:53 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:53 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3" returned: 0 in 0.353s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:53 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:53 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3 Jul 19 13:22:53 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:54 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-199de732-86e1-4245-9f99-863bcab905d3" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-quobyte-199de732-86e1-4245-9f99-863bcab905d3" released by "delete_volume" :: held 0.627s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Created reservations ['38201f41-335d-4374-9d0c-24dfae53e147', '31b8edb8-b019-4c5b-9d94-f585a05aa8ce', '7c6b6251-a697-4164-a439-c24e735e237c', '6a1b71a5-7e10-4f24-8433-5b6eb23c59c5'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:22:54 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:22:54 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:22:54 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.238s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:22:54 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Deleted volume successfully. Jul 19 13:22:54 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-203a5cce-b945-45dc-a268-a6aaf943a0d4 tempest-ProjectReaderTests-1992271573 None] Lock "cinder-199de732-86e1-4245-9f99-863bcab905d3-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:04 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=8,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:23:04 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Flow 'volume_create_manager' (0342e359-7ab6-470b-a212-1f96ce6229af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5852ef96-781e-4f73-8cef-6d824963d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5852ef96-781e-4f73-8cef-6d824963d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1593195574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ae2b79-818b-4513-9bdb-4dd38785d3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08da1d5065a647f6b93152df9f0cf235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:23:14Z,use_quota=True,user_id='1168a4f4991f4e97b9f88ab265bb69ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d28cd0-67dd-48d7-a833-7ec5c9fe4e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d28cd0-67dd-48d7-a833-7ec5c9fe4e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd638e9a-849f-4cec-bca1-7c2b1c1f2bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd638e9a-849f-4cec-bca1-7c2b1c1f2bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ae2b79-818b-4513-9bdb-4dd38785d3de', 'volume_name': 'volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00a592a-70bb-4d19-979d-8f737d8bd67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00a592a-70bb-4d19-979d-8f737d8bd67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ee04bf-1f31-401f-ae61-5dbed8e798c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:14 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Volume d7ae2b79-818b-4513-9bdb-4dd38785d3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de', 'volume_size': 1} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1593195574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ae2b79-818b-4513-9bdb-4dd38785d3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08da1d5065a647f6b93152df9f0cf235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:23:14Z,use_quota=True,user_id='1168a4f4991f4e97b9f88ab265bb69ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)}" {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Creating volume d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:23:14 devstack cinder-volume[87305]: INFO cinder.volume.drivers.remotefs [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] casted to osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de 1073741824 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:14 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de 1073741824 Jul 19 13:23:14 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:14 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de 1073741824" returned: 0 in 0.415s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:14 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:14 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de Jul 19 13:23:14 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:15 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'} {{(pid=87305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ee04bf-1f31-401f-ae61-5dbed8e798c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de', 'volume_size': 1}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586e7fa9-e6d5-46f6-904f-da10649c6faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:15 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Volume volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de (d7ae2b79-818b-4513-9bdb-4dd38785d3de): created successfully Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586e7fa9-e6d5-46f6-904f-da10649c6faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Flow 'volume_create_manager' (0342e359-7ab6-470b-a212-1f96ce6229af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:23:15 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-57a3a877-0f9a-4aad-94e0-68c95164f866 tempest-SnapshotDependencyTests-1392621197 None] Created volume successfully. Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Creating offline snapshot 8cafa3ac-8ca4-443a-a90e-4803812349fc of volume d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53ccfe0-f271-47c8-8a8e-bd35ef684bb0]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:15 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de Jul 19 13:23:15 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:15 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de" returned: 0 in 0.352s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:15 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc 1G {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:16 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc 1G Jul 19 13:23:16 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:16 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc 1G" returned: 0 in 0.382s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:16 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc Jul 19 13:23:16 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:16 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de -F qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc" returned: 0 in 0.284s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:16 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc is being set with open permissions: ugo+rw Jul 19 13:23:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:16 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc Jul 19 13:23:16 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:16 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc" returned: 0 in 0.243s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:16 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:16 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.info Jul 19 13:23:16 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:17 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.info" returned: 0 in 0.248s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:17 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.info is being set with open permissions: ugo+rw Jul 19 13:23:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.info {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:17 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.info Jul 19 13:23:17 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:17 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.info" returned: 0 in 0.238s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:17 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:17 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-ee691d50-c7a3-4931-9104-352cf794522e tempest-SnapshotDependencyTests-1392621197 None] Create snapshot completed successfully Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Flow 'volume_create_manager' (ed782fc7-e4d9-4ebe-9034-fc2752fb807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a17ac64-2986-4421-8e8d-9dbe51d0042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a17ac64-2986-4421-8e8d-9dbe51d0042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T11:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ccaaed-c0ad-4493-a120-4e20de5d44d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08da1d5065a647f6b93152df9f0cf235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T11:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cafa3ac-8ca4-443a-a90e-4803812349fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T11:23:18Z,use_quota=True,user_id='1168a4f4991f4e97b9f88ab265bb69ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decad947-f807-4c3c-a02b-93fa857ed507),volume_type_id=decad947-f807-4c3c-a02b-93fa857ed507)' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be3eca3-3a4c-4ec3-b22c-69fb0ecf2a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be3eca3-3a4c-4ec3-b22c-69fb0ecf2a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51f3b8d-9de3-483c-9362-f2e1a955ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51f3b8d-9de3-483c-9362-f2e1a955ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91ccaaed-c0ad-4493-a120-4e20de5d44d2', 'volume_name': 'volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2', 'volume_size': 1, 'snapshot_id': '8cafa3ac-8ca4-443a-a90e-4803812349fc'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740cd5a7-0949-4cc7-8d39-9ad5502de92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740cd5a7-0949-4cc7-8d39-9ad5502de92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b983c65-691e-4b49-98de-7b9ea5139b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:18 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Volume 91ccaaed-c0ad-4493-a120-4e20de5d44d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2', 'volume_size': 1, 'snapshot_id': '8cafa3ac-8ca4-443a-a90e-4803812349fc'} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-quobyte-8cafa3ac-8ca4-443a-a90e-4803812349fc-91ccaaed-c0ad-4493-a120-4e20de5d44d2" by "_create_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-8cafa3ac-8ca4-443a-a90e-4803812349fc-91ccaaed-c0ad-4493-a120-4e20de5d44d2" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Creating volume 91ccaaed-c0ad-4493-a120-4e20de5d44d2 from snapshot 8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Selected osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4 as target Quobyte volume. {{(pid=87305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-quobyte-91ccaaed-c0ad-4493-a120-4e20de5d44d2" by "_copy_volume_from_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-91ccaaed-c0ad-4493-a120-4e20de5d44d2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] snapshot: 8cafa3ac-8ca4-443a-a90e-4803812349fc, volume: 91ccaaed-c0ad-4493-a120-4e20de5d44d2, {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b56ed8b-b286-4af8-a6bf-77aaf7289339]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:18 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc Jul 19 13:23:18 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:18 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc" returned: 0 in 0.348s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Creating direct copy from snapshot {{(pid=87305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeb53fe-5f77-4af0-bd81-8e6273f02028]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:18 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:18 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de Jul 19 13:23:18 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:19 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de" returned: 0 in 0.351s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:19 devstack cinder-volume[87305]: DEBUG cinder.utils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Path /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 not found in is_blk_device check {{(pid=87305) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 13:23:19 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:19 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 Jul 19 13:23:19 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:23 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2" returned: 0 in 4.069s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65731aa5-5604-4022-97dc-8254212e3b71]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:23 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de Jul 19 13:23:23 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:23 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de" returned: 0 in 0.549s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG cinder.image.image_utils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Image conversion details: src /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 {{(pid=87305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 13:23:23 devstack cinder-volume[87305]: INFO cinder.image.image_utils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Converted 1024.00 MB image at 251.59 MB/s Jul 19 13:23:23 devstack cinder-volume[87305]: WARNING cinder.volume.drivers.remotefs [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 is being set with open permissions: ugo+rw Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:23 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 Jul 19 13:23:23 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:23 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2" returned: 0 in 0.240s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:23 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-91ccaaed-c0ad-4493-a120-4e20de5d44d2" released by "_copy_volume_from_snapshot" :: held 5.644s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-8cafa3ac-8ca4-443a-a90e-4803812349fc-91ccaaed-c0ad-4493-a120-4e20de5d44d2" released by "_create_volume_from_snapshot" :: held 5.674s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.693s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b983c65-691e-4b49-98de-7b9ea5139b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2', 'volume_size': 1, 'snapshot_id': '8cafa3ac-8ca4-443a-a90e-4803812349fc'}' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be38f3-6840-4a26-8ef5-fd9e48b89ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 13:23:24 devstack cinder-volume[87305]: INFO cinder.volume.flows.manager.create_volume [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Volume volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 (91ccaaed-c0ad-4493-a120-4e20de5d44d2): created successfully Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be38f3-6840-4a26-8ef5-fd9e48b89ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87305) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Flow 'volume_create_manager' (ed782fc7-e4d9-4ebe-9034-fc2752fb807c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87305) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 13:23:24 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-f2192c8d-3872-446a-9f6c-a3aa8bb2fa41 tempest-SnapshotDependencyTests-1392621197 None] Created volume successfully. Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-8cafa3ac-8ca4-443a-a90e-4803812349fc-delete_snapshot" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-8cafa3ac-8ca4-443a-a90e-4803812349fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-quobyte-d7ae2b79-818b-4513-9bdb-4dd38785d3de" by "delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-d7ae2b79-818b-4513-9bdb-4dd38785d3de" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-quobyte-8cafa3ac-8ca4-443a-a90e-4803812349fc" by "_delete_snapshot" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-8cafa3ac-8ca4-443a-a90e-4803812349fc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Deleting offline snapshot 8cafa3ac-8ca4-443a-a90e-4803812349fc of volume d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] snapshot_file for this snap is: volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0b086-18bd-470a-ae88-2aaa84b4d7a7]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:24 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:24 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc Jul 19 13:23:24 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:25 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc" returned: 0 in 0.339s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.remotefs [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8703b980-ebed-4bbb-953c-632ae8e5ca3b]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:25 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de Jul 19 13:23:25 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:25 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de" returned: 0 in 0.337s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:25 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc Jul 19 13:23:25 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:25 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc" returned: 0 in 0.327s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:25 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:25 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc Jul 19 13:23:25 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:26 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de.8cafa3ac-8ca4-443a-a90e-4803812349fc" returned: 0 in 0.236s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-8cafa3ac-8ca4-443a-a90e-4803812349fc" released by "_delete_snapshot" :: held 1.328s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-d7ae2b79-818b-4513-9bdb-4dd38785d3de" released by "delete_snapshot" :: held 1.352s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Created reservations ['4c49b1a9-4fff-4f13-ac66-7b17b2940f30', '40653027-1c55-4150-8433-7acbceae42d6', '5557dba4-09a4-4d97-adbf-13a5e43fcf92', 'f00f6c59-5437-4028-9027-7e27641818d6'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:23:26 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Delete snapshot completed successfully. Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-7689a5aa-ff13-4655-ae2d-d1bc7a4e1dba tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-8cafa3ac-8ca4-443a-a90e-4803812349fc-delete_snapshot" released by "delete_snapshot" :: held 1.484s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-d7ae2b79-818b-4513-9bdb-4dd38785d3de-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-d7ae2b79-818b-4513-9bdb-4dd38785d3de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-quobyte-d7ae2b79-818b-4513-9bdb-4dd38785d3de" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:26 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-d7ae2b79-818b-4513-9bdb-4dd38785d3de" acquired by "delete_volume" :: waited 0.014s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d41019b-9961-4899-8840-1896d812a16f]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:27 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de Jul 19 13:23:27 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:27 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de" returned: 0 in 0.337s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:27 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de Jul 19 13:23:27 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:27 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-d7ae2b79-818b-4513-9bdb-4dd38785d3de" returned: 0 in 0.239s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-d7ae2b79-818b-4513-9bdb-4dd38785d3de" released by "delete_volume" :: held 0.626s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Created reservations ['14d5d8ea-8e73-4e0a-9414-c014463bef5f', '80906d1d-9de5-42cb-8efe-f1b3060b09ad', 'f5f53811-ba12-4308-904b-5d120998a853', '4eb93ae3-cee8-42d6-88d6-af781ec13eeb'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:27 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:23:27 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:27 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.245s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:23:27 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Deleted volume successfully. Jul 19 13:23:27 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-4211e7b5-5f2e-4c67-9119-734852e979e6 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-d7ae2b79-818b-4513-9bdb-4dd38785d3de-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-91ccaaed-c0ad-4493-a120-4e20de5d44d2-delete_volume" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-91ccaaed-c0ad-4493-a120-4e20de5d44d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "cinder-quobyte-91ccaaed-c0ad-4493-a120-4e20de5d44d2" by "delete_volume" {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-91ccaaed-c0ad-4493-a120-4e20de5d44d2" acquired by "delete_volume" :: waited 0.018s {{(pid=87305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo.privsep.daemon [-] privsep: reply[788fb190-e5b7-49c9-bce4-a22bab6687c3]: (4, 'qcow2') {{(pid=88583) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:28 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 Jul 19 13:23:28 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:28 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2" returned: 0 in 0.347s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:28 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2 Jul 19 13:23:28 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:28 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb/volume-91ccaaed-c0ad-4493-a120-4e20de5d44d2" returned: 0 in 0.239s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-quobyte-91ccaaed-c0ad-4493-a120-4e20de5d44d2" released by "delete_volume" :: held 0.633s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.quota [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Created reservations ['0b6d83fe-08ff-4183-91de-edc637d1fd39', 'e55040fb-57f6-44bb-b486-7706878e49f8', '56443f1d-4483-4207-98e3-2f666280c054', 'db612ead-3eaf-4231-aacc-e52eb7415f24'] {{(pid=87305) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:28 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:28 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:23:28 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:29 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:29 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.242s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:29 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:23:29 devstack cinder-volume[87305]: INFO cinder.volume.manager [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Deleted volume successfully. Jul 19 13:23:29 devstack cinder-volume[87305]: DEBUG cinder.coordination [None req-2c25f060-5ef5-4183-ab11-9b73aa5b2517 tempest-SnapshotDependencyTests-1392621197 None] Lock "cinder-91ccaaed-c0ad-4493-a120-4e20de5d44d2-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87305) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 13:23:38 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:UPDATE=32,cinder:SELECT=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:23:39 devstack cinder-volume[87305]: DEBUG dbcounter [-] [87305] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87305) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4': None} {{(pid=87305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG cinder.volume.drivers.quobyte [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0ee0b29-18c1-4df4-a476-7124b84771b4'] {{(pid=87305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.lockutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87305) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 13:23:42 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb Jul 19 13:23:42 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 13:23:42 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG oslo_concurrency.processutils [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aa05c62252ba54d57126d4f4e1890fcb" returned: 0 in 0.239s {{(pid=87305) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG cinder.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Notifying Schedulers of capabilities ... {{(pid=87305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG oslo_service.periodic_task [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] Running periodic task VolumeManager._thread_info {{(pid=87305) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread count: 29 {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 13:23:42 devstack cinder-volume[87305]: DEBUG cinder.volume.manager [None req-5c672e01-b766-493b-b9c8-0763221627f0 None None] thread info: [<_MainThread(MainThread, started 126812532818048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87305) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}